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The work in this thesis is a development and extension of the work begun 
originally by Drs. Nathan Kogan and Karl Joreskog. Kogan's work in creativity 
testing and its relationship to intelligence and achievement is the bacis for the 
content of the thesis. Joreskog 's work in the development of factor analytic tech- 
niques is the basis for its methodology. 

In 1965, Wallach and Kogan (1965a) published the results of their research on 
creativity in the text Modes of Thinking in Young Children > They studied a group 
of children with a mean age of 10 years, 8 months using materials on creativity 
which have come to be referred to in the literature as the Wallach and Kogan tests 
of creativity. They provided evidence for the existence of a creativity dimension 
distinct from intelligence. 

Since 1965, William Ward (ETS) , Cropley and Maslany (University of Saskatchewan), 
and Wallach and Wing (Duke University) have administered the Wallach and Kogan 
materials to elementary school children and to college students. They corroborated, 
with varying' degrees of success, the Wallach and Kogan hypothesis. 

In this thesis, the original data of Wallach and Kogan, as well as the data from 
the Ward, Cropley and Maslany, and Wallach and Wing studies are reanalyzed using 
Joreskog 's Unrestricted Maximum Likelihood Factor Analysis (UMLFA) • In addition, 
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13. Abstract (Continued) 



three of the Guilford studies and the Getzels and Jackson 1962 study on 
creativity and intelligence have been reanalyzed ising the UMLFA technique. 
These reanalyses provide clear evidence not only for the distinct creativity 
and intelligence dimensions but also for figural and verbal subfactors in 
the creativity dimension. In some cases, the previous data were not factor 
analyzed. In these cases, the UMLFA technique provides clear evidence for 
subfiCtors. In cases where the data were previously factor analyzed, the 
UMLFA technique provides for a clearer interpretation of the data. The 
difference between this unrestricted maximum likelihood technique and 
other factor techniques is that this technique is developed on the basis 
of underlying normally distributed variables and the existence of a likeli- 
hood function that is minimized. 

In addition to these reanalyses, the Wallach and Kogan materials were 
used in an original research study vrith secondary school students from a 
large high school in Brooklyn, New York. The two-factor structure of the 
creativity dimension was clearly verified. In addition, the creativity 
measures were related to many more common measures of intelligence than 
have been reported in studies thus far. Also, the creativity and intelli- 
gence measures were related to actual school grades in science, mathematics, 
English, and social studies. Three factors clearly related to creativity, 
intelligence, and school achievement were identified using the UMLFA tech- 
nique. The figural and verbal subfactors in the creativity dimension were 
also clearly identified. The independence of the creativity and intelli- 
gence dimensions was verified, and a marginal relationship between creativity 
and school grades was indicated in the factor structure. To further verify 
this final indication, indices of creativity, intelligence, and school 
achievement were developed. The school achievement index was then used 
as the dependent variable in a multiple regression with creativity and 
intelligence as independent variables. The regression was carried out 
with each variable alone » with both jointly, and in stepwise progression 
with intelligence first and creativity second. The conclusions indicated 
in the factor structure were confirmed in each case. 

In summary, then, this thesis provides rather good evidence for the 
existence of a creativity dimension containing figural and verbal subfactors 
which is independent from intelligence and marginally related to school achieve- 
ment. This evidence was obtained by reanalyzing the data from previous studies 
and by an original research study with high school students. 
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The work In this thesis is a development and extension of the work 
begun originally by Drs. Nathan Kogan and Karl Joreskog.' Kogaa's work in 
--reativity testing and its relationship to intelligence and achievement is 
the basis for the content of the thesis. Jo'reskog's work in the development 
of factor analytic techniques is the basis for its methodology. 

In 1965, Wallach and Kogan (1965a) published the results of their research 
on creativity in the text Modes of Thinking in Young Children . They studied 
a group of children with a mean age of 10 years, 8 months using materials 
on creativity which have come to be referred to in the literature as the 
Wallach and Kogan tests of creativity. They provided evidence for the 
existence of a creativity dimension distinct from intelligence. 

Since 1965, William Ward (ETS), Cropley and Maslany (University of 
Saskatchewan) , and Wallach and Wing (Duke University) have administered 
the Wallach and Kogan materials to elementary schpol children and to college 
students. They corroborated, with varying degrees of success, the Wallach 
and Kogan hypothesis. 

In this thesis, the original data of Wallach and Kogan, as well as the 

data from the Ward, Cropley and Maslany, and Wallach and Wing studies are 
It 

reanalyzed using Joreskog 's Unrestricted Maximum Likelihood Factor Aualysis 
(UMLFA). In addition, three of the Guilford studies and the Getzels and 
Jackson 1962 study on creativity and intelligence have been reanalyzed using 
the UMLFA technique. These reanalyses provide clear evidence not only for 
the distinct creativity and intelligence dimensions but also for figural and 
verbal subf actors in the creativity di-fension. In som? cases, the previous 



data were not factor analyzed. In these cases, the IMLFA technique 
provides clear evidence for subf actors. In cases where the data were 
previously factor analyzed, the UMLFA technique provides for a clearer 
interpretation of the data. The difference between this unrestricted 
maximum likelihood technique and other factor techniques is that this 
technique is developed on the basis of underlying normally distributed 
variables and the existence of a likelihood function that is minimized. * 

In addition to these reanalyses, the Wallach and Kogan materials 
were used in an original research study with secondary school students 
from a large high school in Brooklyn, New York. The two-factor structure 
of the creativity dimension was clearly verified. In addition, the 
creativity measures were related to many more common measures of intelli- 
gence than have been reported in studies thus far. Also, the creativity 
and intelligence measures were related to actual school grades in science, 
mathematics, E- -^ilsh, and social studies. Three factors clearly related 
to creativity, diligence, and school achievement were identified using 
the UMLFA technique. The figural and verbal subf actors in the creativity 
dimension were also clearly identified. The independence of the creativity 
and intelligence dimensions was verified, and a marginal relationship between 
creativity and school grades was indicated in the factor structure. To 
further verify this final indication, indices of creativity, intelligence, 
and school achievement were developed. The school achievement index was then 
used as the dependent variable In a multiple regression with creativity and 
intelligence as independent variables. The regression was carried out with 
each variable alone, with both jointly, and in stepwise progression with 



intelligence first and creativity second* The conclusions indicated 
in the factor structure were confirmed in each case. 

In summary, then, this thesis provides rather good evidence for the 
existence of a creativity dimension containing flgural and verbal subfactors 
which is independent from intelligence and marginally related to school 
achievement. This evidence was obtained by reanalyzing the data from previous 
studies and by an original research study with high school students. 
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FOREWORD 

The primary challenge facing the factor theorist in psychology is to 
identify those underlying factors which explain or at least account for 
varying amounts of human behavior. To be useful, the factors must be 
neither too general nor too specific. The history of the development of 
the intelligence factor seems to indicate that a fruitful way to proceed 
is to identify an underlying factor that is somewhat general and then to 
examine its stibstructure. It was by showing that intelligence was not a 
xjnitary factor that Thurstone developed his primary mental abilities. These 
primary mental abilities have proved useful in studying human behavior, 
especially behavior related to the process of education. Using school grades 
as a measure of "success," the primary mental abilities have predicted success 
rather well. 

Measures of success have changed radically in the last decade. Emphasis 
on grades has decreased. Many courses in college are now offered on a pass- 
fail basis. Many high schools are offering expanded programs of elective 
courses in whidi motivation and interest are as important prerequisites as 
intellectual ability. The educational system in general is becoming much 
more coiiq>lex, and this complexity is probably a natural outgrowth of advances 
in psychology and education which have led to a better understanding of the 
individual differences among children and a better appreciation of the 
possibilities for a more total development of the student's personality. The 
recognition of complexity in the individual and the concurrent success in 
developing devices to identify and measure th'^ many^f acets of the individual 
will naturally result in a more coiq)licated model of a student than that 
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provided by one intelligence measure. Indeed, the Inadequacy of a monolithic 
intelligence as the underlying factor of much of human behavior has long been 
recognized, and much research has attempted to identify other underlying 
factors in order to provide a more complete picture. 

One area of development that has received much attention during the 
recent past is that of "creativity." Naturally, there is disagreement about 
what creativity really is. This should not be surprising. Psychologists 
have been measuring intelligence for years without knowing what it really 
is* In fact, L. L. Thurstone presented a paper in 1950 on creative talent 
in which he pointed out that we may discover how to select people with 
creative talent before we learn much about the nature of that kind of talent. 
Nevertheless, even the gross variable of intelligence has b-en very useful. 
Knowledge of its substructure has increased its usefulness. Some researchers 
now believe that there is sufficient evidence for the existence of a 
creativity dimension, a dimension on which individuals will differ when 
measured appropriately. In addition, some researchers claim that this dimen- 
sion will be distinct from intelligence. These claims will be examined in 
this thesis. 

Assuming that it could be done, what value would there be in identifying 
such a dimension? It may very well be on this dimension that current changes 
in education have their greatest effects. Since 1957, with the impetus 
provided by Russia's successful launching of Sputnik I, goals and methods 
of education in the United States have undergone significant changes. The 
goal of learning the specific facts in a discipline has been replaced by the 
goal of learning to understand the structure of the discipline. New methods 
include independent ?tudy, group discussion, field work, and student discovery. 
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Thus, for more than ten years some schools have been trying to develop a 
student who differs in several important ways from the pre-1957 student. 
How is this new student to be evaluated? If new goals have been set and 
I new methods are being used, then perhaps new measuring instruments are 

^ needed to evaluate whether the methods are successful and whether the goals 

? are reached. The students profiting from such an education might be more 

7 Independent, more flexible, more articulate, and more original. ^ The tests 

i. 

: involved in creativity testing might be involved with factors underlying 

I 

I such human behaviors. At any rate, the attempt to identify and delineate 

> 

I such a factor seems to be a worthwhile undertaking. 

i 
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CHAPTER 1 

SURVEY OF THE CREATIVITY TESTING RESEARCH 



1%1 Introduction 

It is rather important at the beginning to limit the range of the 
discussion. Creativity is a very broad area. There are many books and 
articles which deal with it. Excellent and extensive surveys of the 
literature can be found in Stein and Heinze, 1960; C. W. Taylor, 1964a; 
and Stein's recent chapter in the Handbook of Personality Theory and 
Research > 1969* 

In this thesis, the primary concern will be with testing for 
creativity. Specifically, the attempt will be made to justify and give 
a theoretical basis for the particular tests used by Michael Wallach and 
Nathan Kogan in their research study which was eventixally published in the 
book Modes ot Tl> inking in Yount^ Children (1965a) . In order to do this most 
convincingly, it vill be helpful to examine a number of studies that pre*- 
ceded the Wallach and Kogan study* 

1.2 J. P. Guilford and the Aptitudes Research Project 

On September 3» 1950 > Guilford presented his presidential address 
entitled Creativity to the American Psychological Association. That speech 
is generally recognized as having signaled the beginning of a new era in 
the study of creativity. Indeed, it signaled the beginning of Guilford's 
own research which has spanned two decades and has influenced almost all 
other researchers in creativity testing. Guilford outlined a plan for a 
comprehensive assault on the area of creativity using a variety of measuring 
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devices and the techniques of factor analysis. On Deceaier 31, 1969, after 
.aving performed 36 major factor analyses, published 41 technical reports, 
claimed the identification of some 98 unique abilities, and devised numerous 
measuring instruments, Guilford and his associates at the Aptitudes Research 
Project published their final report. 

Guilford began his work by attempting to discover hitherto unknown 
intellectual factors along the line of the Thurstone mental abilities. In 
his 1950 paper, he had hypothesized that creative thinking would include 
such factors as sensitivity to problems, ideational fluency, flexibility of 
set, ideational novelty, synthesizing ability, analyzing ability, reorganizing 
or redefining ability, span of ideational structure, and evaluating ability. 
Definitions of these factors can be found in Guilford's general summary of 1969. 
Guilford devised tests to measure these and various other factors. Eventually, 
as more and more factors became identified, Guilford began to construct a 
general theory of factors, the structure-of-lntellect theory, which included 
120 separate factors. The model for this theory is well known, a three 
dimensional rectangular parallelepiped with dimensions corresponding to 
various contents, operations, and products. Greater detail can be found in 
Guilford's The Nature of Human Intelligence . 1967. 

The important consideration for this thesis is whether or not Guilford 
has succeeded in identifying by his various tests a dimension which .an be 
fairly called creativity and which is distinct from intelligence. Guilford 
claims that he has. Others (Q. McNemar, 1964; R. L. Thomdike, 1962; Wallach 
& Kogan, 1965a) claim that he has not. The difficulty lies in the fact- that 
Guilford's factor studies contain numerous variables, numerous tests, and 
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numerous factors* His theory of creativity has evolved into selecting a 
certain subset of the 120 factors in his loodel to account for creative 
thinking. These include primarily his divergent thinking factors. In 
studies using these factors » Guilford does not include a measure of general 
intelligence. Quinn McNemar^ in his presidential address to the American 
Psychological Association in 1964 » scored Guilford rather harshly for this 
omission. 

Does the failure to include an IQ test help one learn the extent 
to which one must go beyond the boundaries of the IQ (this refers 
to one of the aims that Guilford had set in his 1950 address) to 
fathom creativity? Apparently the author (Guilford) , although 
willing to predict that the correlations between IQ and the many 
types of creativity tests "are only moderate or low," was unwill- 
ing to include an IQ test for the sake of finding out. However, 
negation by omission is not very convincing. 

R. L* Thomdike (1962) has also attempted to shed some light on this 

difficulty of identifying a creativity dimension. 

We may appropriately ask how well the attribute "creativity" 
meets these joint criteria of designating a reasonably 
extensive set of behaviors vhich (1) have some degree of 
coherence and (2) can be distinguished from other sets of 
behaviors. 

And more specifically for the domain of testing. 

In the test domain, as distinct from the life activities domain, 
the question as to the meaningfulness of a general rubric of 
"creativity" can be raised somewhat more Incisively. We may 
ask whether there is a variety of different test behaviors that 

(1) seem reasonably to pertain to the concept of "creativity »" 

(2) are associated so that a person who tends to exhibit one 
al30 tends to exhibit i:he other, and (3) are distinct from 
other sets of test behaviors such as the set to which we have 
applied the term "abstract intelligence." 

Thomdike makes a good analogy to the domain of intelligence to clarify this 

point further. 



The essential points are that although there Is a degree of 
specialization of Intellectual functioning, so thai two tests 
within a specific region of content or process correlate more 
highly than those from different regions, still the correla- 
tions across regions are appreciably positive. It Is these 
uniformly positive correlations, whether conceptualized as G, 
or a second-order factor among the primary factors, or as an 
overlapping of group factors, that give some substance to the 
general concept of abstract intelligence and some reasonable- 
ness to pooling a set of subtests into a common score* 

We m^ appropriately ask whether there is xmother broad 
second-order factor in the test domain, distinct from the 
traditional G, to which the term ''creativity" can be appro- 
priately applied. The existence of such a distinct factor 
is strongly iiq>lied in the piiblicaticxi? by Getzels and 
Jackson and by Torrance, among others, and Guilford and 
his associates have fairly sharply differentiated between 
tests of convergent and divergent thinking. How well does 
this differentiation of two broad :ogaitive domains hold up 
in practice? 

I have reanalyzed some of the published data to try to 
get a partial answer to these questions. 

In reanalyzing the Guilford data, Thorndike used the following technique 
He classified the various factors as "old-line or convergent thinking factors 
or as "new-type divergent thinking (i.e., creativity) factors." He then 
selected the two tests which loaded highest on each of the factors to 
represent that factor. He then prepared correlation matrices including only 
these tests. Using this reduced correlation matrix, he determined the 
average correlation of each test with the other "convergent" tests and with 
the other "divergent" tests. He used these correlations as indications of 
the extent to which a test is related to the tests in its own domain and the 
extent to which it is related to the tests in the other domain. 

Thorndike applied this technique to two batteries of the Guilford tests 
reported in the technical reports of the Aptitudes Research Project. In the 
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first reanrlysis, Tnorndike reported an average correlation of .23 among 
the "convergent" tests, of .14 among th« "divergent" tests, and eii average 
correlation of .12 between the two sets of tcstiz. In tb .second rcanalysis, 
the corresponding correlations were .43, .27, and .24. Uallach and Kogan 
conclude from this that "the general intelligence procedures are more hii^bly 
related among themselves than the divergent thinking procedures, and the 
divergent thinking procedures are almost as strongly related to the general 
intelligence indicators as the divergent thinking procedures are related 
among themselves,** and that "most of what unites the divergent thinking 
measures is the variance they have in common with the indicators of general 
intelligence." 

Although this conclusion of Wallach and Kogan may be true,, it is not 
warranteu by the Thomdike reanalyses. Average correlations do not indicate 
the existence of factors. If the existence of factors is the desired 
conclusion, then the correlation matrix should be factor analyzed. Such 
factor analyses are presented in the following. 

In this thesis f I have reanalyzed three reduced correlation matrices from 
Guilford*s reports numbered 8, 12, and 35. These studies identified factors 
which Guilford termed divergent and convergent, in study number 8, the three 
highest loading tests on the Verbal Comprehension factor and the three tests 
with the highest loadings on the Numerical Facility factor were combined in 
a correlation matrix with the two highest loading tests on the factors 
identified as Word Fluency, Associational Fluency, Ideational Fluency, and 
Originality. One test loaded high on two factors; thus, there are a total 
of thirteen tests. An unrestricted maximum likelihood factor analy&is 
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(UMLFA) was performed on the data. This factor analytic technique is used 
throughout this thesis. It is a technique originated by D. N. Lawley in 
1940 and greatly developed by Karl JBreskog in the past few years (an 
explanation of the technique is given in JBreskog, 1967b). To understand 
the points made in this section it is sufficient to know that this technique 
gives the most likely solution for a given i^umber of factors under the 
assuiiq>tion of normally distributed underlying traits. The pattern of 
loadings on the factors indicates the cop*:ributions of the factors to the 
behavior (test scores) being analyzed. The Varlmax Rotated solution for 
two factors is given in Table 1.2.1. While the first factor is largely 
determined by the assumed convergent tests, test number five has higher 
loadings than three of the convergent tests and test number seven has the 
highest loading of all. The negative loading of test number eight could be 
made positive by simply reversing the scoring. The second factor is deter- 
mined largely by the OriginaUty and Ideational Fluency tests. While this 
analysis is not perhaps the most convincing, it seems to permit a more lenient 
criticism than that of McNemar and Thomdike, i.e., that, although many of 
the Guilford so-called "divergent" tests do not appear to define a convincing 
"divergent" factor, some of the tests do appear to define a factor on which 
the common "convergent" tests (verbal comprehension and numerical facility) 
load poorly. 

Similar analyses were performed on reduced correlation matrices for 
Guilford's Studies 12 and 35. The adaptive flexibility factor in Study 12 
loads poorly on the divergent factor. Othetwise, the divergent and conver-- 
gent factors are evident. The evidence in Study 35 is not as good. Five 
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Table 1.2.1 

(Guilford, Wilson, and Cbristensen) 

Maximum Likelihood Solution for TWo Factors 

Study #8 
(1952) 



Unique Variances 

1 0.697 0.822 0.388 0.520 0.652 0.721 0.503 0.684 
0 . 569 0 . 705 0 . 733 0.657 0. 649 



Varimax-Rotated Factor Matrix 



Ideational Fluency 1 


-0.072 


0.546 


Originality 1 


0.169 


0.387 


Ideational Fluency 2 


-0.034 


0.782 


Originality 2 


-0.031 


0.692 


Word Fluency 1 


0.580 


0.105 


Associational Fluency 1 


0,339 


0.406 


Word Fluency 2 


0.689 


0.150 


Associational Fluency 1 


-0.544 


0.140 


(Verbal Comprehension 1) 






Verbal Comprehension 2 


0.656 


0.020 


Verbal Comprehension 3 


0.538 


0.074 


Numerical Facility 1 


0.513 


0.064 


Numerical Facility 2 


0.586 


0.022 


Numerical Facility 3 


0.592 


-0.005 
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Table 1.2.2 

(Guilford, Berger, and Christensen) 

Maximum Likelihood Solution for Two Factors 

Study #12 
(1955) 

Unique Variances 

1 0.433 0.619 0.790 0.840 0.844 0.780 0.801 0.853 
0.731 0.568 0.691 0.854 0.797 



Varimax-Rotated Factor Matrix 



Elaboration 1 


0.723 


0.211 


Elaboration 2 


0.600 


0.143 


Originality 1 


0.375 


0.263 


Adaptive Flexibility 1 


-0.083 


0.391 


Originality 2 


0.329 


0.219 


Ideational Fluency 1 


0.454 


-0.116 


Ideational Fluency 2 


0.441 


-0.068 


Adaptive Flexibility 2 


-0.008 


0.384 


(Verbal Conprehension 1) 






Verbal Comprehension 2 


0.183 


0.485 


Numerical Facility 1 


0.009 


0.657 


Verbal Comprehension 3 


0.235 


0.503 


Numerical Facility 2 


0.089 


0.372 


Numerical Facility 3 


0.091 


0.442 
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Table 1.2.3 

(Hoepfner and Guilford) 

Maximum Likelihood Solution for Two Factors 

Study #35 
(1965) 



t 
I 

I- 
I 

I 
I 

r 
I 



0.578 
0.494 



Key 



Unique Variances 



0.834 
0.676 



0.589 
0.358 



0.789 
0.684 



0.627 
0.597 



0.768 
0.504 



0.839 
0.573 



0.634 
0.582 



Varimax-Rotated Factor Matrix 



DFC 1 


0.528 


0.378 


DFC 2 


0.398 


0.086 


DFU 1 


0.049 


0.639 


DSC 1 


0.354 


0.293 


DFU 2 


-0.008 


0.610 


DSU 1 


0.443 


0.189 


DSC 2 


0.171 


0.362 


DSU 2 


0.463 


0.390 


CMI 1 


0.488 


0.517 


CFC 1 


0.569 


-0.026 


CMU 1 


0.781 


0.179 


CFC 2 


0.546 


0.136 


CMI 2 


0.505 


0.384 


CSR 1 


0.67A 


0.204 


CMU 2 


0.650 


0.063 


CSR 2 


0.608 


0.219 



Position 1 

D = divergent 
C = convergent 



Position 2 

F = figural 
S « symbolic 
M = semantic 



Position 3 

C « classes 
U « units 
I 3 implications 
R = relations 
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of the divergent sub factors have higher loadings on what appears to be a 
convergent factor. 

To summarize this section, the Guilford studies do provide some evi- 
dence for the existence of divergent and convergent factors. The coherence 
of the divergent factor is not evident. The distinction between the two 
does not seem evident from the data. 

1.3 E. Paul Torrance and the Minnesota Tests of Creative Thinking 

E. Paul Torrance and his co-workers adapted a number of the Guilford 
tests and added a number of their own to form a creativity test battery. 
The tests are described in an appendix of Torrance's Guiding Creative Talent 
(1962). Unfortunately, Torrance does not report correlations in his research. 
Rather, to provide evidence for separate dimensions (intelligence and 
creativity), he ranks students on the basis of an intelligence score and 
separately on the basis of a creativity score. This creativity score is 
determined by summing the scores on the separate creativity tests. This is 
done without giving inter test correlations to justify such summing. In 
criticizing the Getzels and Jackson study which used similar tests, McNemar 
pointed out that although the median intercorrelaticn among the creativity 
tests was only .28, the authors went on and used a sum score for most of 
their analyses. The correlations of the IQ scores with the various subtests 
is given in coluim 6 of Table 1.4.1. McNemar found that the sum score cor- 
related .40 with intelligence. I think a similar criticism can be leveled 
at Torrance. At any rate, Torrance after ranking the students selects the 
top 20% in each group. Then he eliminates those common to both groups. 



Then he compares the remaining groups. This simply involves ignoring too 
much of the data to allow the final conclusions to be very convincing. He 
found a significant difference between the two groups,- the high IQ group 
having a mean intelligence of 141.7 and the high creative group a mean IQ 
of 122.0. 

In referring to the work of Torrance, R. L. Thomdike in his 1962 paper, 

referred to in the previous section, has the following comment to make: 

I would very much like to apply this same type of critical (if 
not creative) analysis to the tests that Torrance has been 
developing at Minnesota. So far, I have not encountered a set 
of data that lent themselves to this app roach • Thou^ Torrance 
has expressed commendable concern about rater reliability in 
appraising the protocols from his tests, I have not encountered 
the same type of concern about trait reliability, that is, the 
consistency with which his tests, measure some coimaon attribute 
to which a common designation may legitimately be applied. 
Though Torrance specifically disavows intending to produce a 
test to produce a Creativity Quotient that would constitute a 
characterization of an individual, he often uses a team of his 
tests as if they did produce one, or at least as if they had 
enough in common to justify pooling them into a single composite 
score. I would suggest that a good deal of further study of 
the behavior domain is needed before this is done. 



1.4 The Getzels and Jackson Study 

Getzels and Jackson (1962) administered a creativity battery to 533 
students of above average intelligence in a mid-western school. One 
intelligence measure was obtained from the school, the Stanford-Binet , 
Wise, or Henmon-Nelson. Their study is one of the most widely known. They 
verified a number of rather interesting hypotheses relating to creativity 
and achievement, creativity and self-concept, creativity and conformity, 
and creativity and teacher preference. Yet, their analysis has come under 
extremely sharp criticism. 



Table 1.4.1 
Getzels and Jackson Study 



Intercorralations among Creativity and Intelligence Tests 



Boys (above diagonal) N » 292 
Variable Number 



Variable 
Number 


Test 


1 


2 


3 


4 


5 


6 


1 


Word Association 




369 


344 


303 


420 


378 


2 


Uses 


371 




206 


222 


175 


186 


3 


Hidden Shapes 


351 


197 




159 


414 


366 


4 


Fables 


320 


276 


153 




220 


131 


5 


Make-up Problems 


488 


279 


525 


269 




246 


6 


Intelligence Quotient 


371 


1A7 


303 


115 


393 





Girls (below diagonal) N « 241 



From Creativity and Intelligence by J. W. Getzels and P. W. Jackson. 
Copyright fc^ 1962 by J. W. Getzels and P. Jackson. Reprinted by 
permission of John Wiley and Sons. 
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Table 1.4.2 
(Table 1 of R. L. Thomdlke) 

First Factor Loadings of the Getzels and Jackson Creatlvltv Tests and 10 





Boys 


Girls 


1. Word Association 


.69 


.70 


2. Uses 


.47 


.48 


3. Hidden Shapes 


.58 


.60 


4. Fables 


.41 


.42 


5. Make-up Problems 


.58 


.72 


6. I.Q. 


.52 


.30 


Average 


.54 


.57 



From "Some Methodological Issues In the Study of Creativity" by 
R.- L. Thomdlke In Proceedings of the 1962 Invitational Conference 
on Testing Problems" Copyright (c) 1963 by Educational Testing Service. 
All rights reserved. 
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Table 1.4.3 
Getzels and Jackson Study (Boys) 

Maxlnum Likelihood Solution for Oae Factor 

ttirotated Factor Hatrlx 

1 0.725 

2 0.430 

3 0.559 

4 0.375 

5 0.581 

6 0.506 



Unique Variances 
0.474 0.815 0.687 0.859 0.663 0.744 



Table 1.4.A 
Getzels and Jackson Study (Boys) 



Maximum Likelihood Solution for TWo Factors 



Unique Variances 
0.264 0.814 0.0 0.865 0.707 0.769 

Varimax-Rotated Factor Matrix 

1 0.184 0.83d 

2 0.128 0.412 

3 0.981 0.196 

4 0.O91 0.356 

5 0.338 0.423 

6 0*298 0.377 



The correlation table for the data in this study is given in Table l.A^l. 
For girls, the average correlation among the creativity tests is .32 while 
the average correlation between the creativity tests and the intelligence 
test is •27. For boys, the average correlation aoong the creativity tests 
is ♦28, while the average correlation between the creativity tests and 
intelligence is «26« Wallach and Kogan point out, in addition , that nine of 
the ten creativity tests are significantly correlated (p less than .05) with 
the intelligence test. There is scant evidence here for a unified dimension 
distinct from intelligence* 

In reanalyzing the Getzels and Jackson data, R. L. Thomdike makes the 

following statement: 

Getzels and Jackson emphasize the lack of correlation between 
the traditional intelligence test and the measures that they 
used to appraise creativity. However , the intercorrelations 
of the five "creativity" tests were themselves not very high. 
It is of some interest to extract a first factor from this 
table of correlations and coiiq>are the factor loadings of the 
several tests. The results are shown in Table 1 (1.4.2)* 
Thus 9 we see that on the first factor comnon to these six 
measures, the factor loadings are all fairly modest and the 
loading for the conventional intelligence test falls about 
midway among the "creativity" tests. 

In reanalyzing the Getzels and Jackson data using UMLFA, the one and two 

factor solutions given in Tables 1.4*3 and 1.4*4 were obtained. It is clear 

from this reanalysis that no single two factor structure corresponding to 

intelligence and creativity is present in the Getzels and Jackson data. 



1*5 Summary 



A number of other studies could be described to continue this same kind 
of analysis, but I think the point should be sufficiently clear. A two factor 
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structure corresponding to intelligence and creativity haa not been con- 
vincingly demonstrated in even the most noted studies. In addition, using 
a sum score for creativity is hardly justified unless the individual 
tt^^asures are adequately correlated. This seems to be the necessary require- 
ment for the data if the researcher is to avoid being deserving of the 
following criticism of McNemar: "Xhe factor analytic studies indicate 
either no, or a trivially small, general creativity factor in these tests, 
yet these self-characterized 'bold, adventurous' reformers do not hesitate 
to advocate a total score which is nearly devoid of meaning." 



CHAPTER 2 

AN ASSOCIATION APPROACH TO CREATIVITY 

2.1 Introduction 

The conclusion reached In the preceding chapter was that the empirical 
evidence for the existence of a creativity dimension was unconvincing. 
Michael Wallach and Nathan Kogan (196Sa) suggested concentrating on a less 
diffuse set of abilities closely related to association in an attempt to 
get at creativity. These association abilities, they hypothesized, could 
best be assessed in an atmosphere that was relaxed and gai&e-llke. The 
Guilford tests differed in that they were administered with strict time 
constraints. Wallach and Kogan devised a sot of materials, some oiiginal, 
some adapted from previously used creativity tests. They used these materials 
in their research study. 

Before considering their actual research in Chapter 3, a theoretical 
basis for their approach to creativity will be presented in Chapter 2. 

2.2 Samoff A. MednicK*s "The Associative Basis of the Creative Process" 
In 1962, Mednlck published his noted article on the associative -basis 

of the creative process. In it, he defines creative thinking as ". . . the 
forming of associative elements into new conbinations which either meet spe- 
cific requirements or are in some way useful. The more mt^tually remote the 
elements of the new combination, the more creative the process or solution." 
To support this definition, Mednick listed a number of quotes by ostensibly 
creative people. The quotes are from Ghiselin's The Creative Process (1952). 

Einstein suggests that "combinatory play seems to be the essential 
feature in productive thought." 
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Polncare tells of being unable to sleep one night wiicn **idts«8 rose in 
crowds; 1 felt them collide until pairs interlocked so to spc /i, making a 
stable combination." Later he states that "to create consists of making 
new combinations of associative elements which are useful*** 

Mozart refers to occasions upon which his "ideas flow best and toost 
abundantly." 

Dryden describes the production of "a confused Mass of Thoughts,^ 
tumbling over oae another in the Dark." 

A. E. Hausman, in his llie Name and Nature of Poat ry. speaks of a spring 
of ideas bubbling up within him. 

It was based upon considerations such as these that Mednick fonmilated 
his theory of creative thinking. Later on (1969), he replied to a letter 
by R. W. Hood in which he agreed with Hood that it would be advirable to 
drop the requirement of usefulness from the definition and simply si;:3ss 
the meeting of specific requirements. A survey of the Psydiological Abstracts 
shows that Mednick became mere and more interested in research on schizophrenia 
and less and less on creativity after 1962. 

In his 1S62 article, Mednick stated a nuaber of hypotheses which are 
relevant to the Wallach and Kogan research. One such hypothesis was that 
"the greater the number of associations that ar. individual has to the 
requisite elements of a problem, the greater the probablxity of hio reach- 
ing a creative solution." Mednick thus coiksiders the ability to generate 
associations as a necessary condition for creativity. Another hypothesis 
of Mednick is that "it seems likely that this variable (number ;€ associations) 
will not de related to speed of creative solution." This supports Wallach 
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and Kogan's insistence on a game-like setting with no time constraints in 
testing for creativity. 

Mednlck decided to try to get at this ability to generate associations 
by devising his Remote Associates Test (RAT) • His idea was to provide 
stimuli from mutually remote associative clusters and have the subject 
find a mediating link which combines them. He stressed the point that the 
mediating link must be strictly associative rather than logical. The 
following is an example of an item on the RAT. The subject would be pre- 
sented with the words rat, blue, and cottage. He would be expected to reply 
"cheese" as a mediating link among the three items. 

In 1962, Mednlck reported a correlation of .70 between RAT scores and 
r.eativity ratings by design instructors in a college of architecture. With 
first year psychology graduate students, Mednlck found that the Remote 
Associates Test differentiated between those rated high and low by their 
instructors on creativity in research. On the other hand, C. W. Taylor (1964a) 
found that thB test did not correlate well with- ratings obtained by high 
school students in a program of research sponsored by the National Science 
Foundation. At the present time, research seems to exist to support both 
viewpoints. The difficulty here is that the ratings Involved are suspect. 
Thurstone warned in 1950 that "to make judgments about students as to their 
originality is so different from the customary academic judgments about 
scholarship that there is some question whether we can trust available judg- 
ments for this kind of study." 

Correlations of approximately .40 between RAT scores and various measures 
of intelligence have been reported in the literature. Michael Wallach (1970) 
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cites values of .41, .31, .35, and ,48 as reported in studies by M. Mednick, 
Rainwater, Mendelsohn and Griswold, and Laughlin respectively. Measures of 
intelligence in these studies included scores on the Miller Analogies Test, 
Terman's Concept Mastery Test, and several vocabulary tests. These 
correlations, together with differing conceptions of creativity in Archi- 
tecture and Science, could account for the results of the rating studies 
cited. It is simply not possible to justify the validity of a creativity 
measure by means of an external criterion at present. 

2.3 C. W. Taylor and the Utah Conferences on Creativity 

C. W. Taylor has published several books on creativity, most of them 
derived from the proceedings of the conferences on creativity which he has 
sponsored at Utah. While he provides some support for the association 
approach to creativity, he probably would consider the approach too narrow. 
In 1963, Taylor (C. W. Taylor, Smith, & Oiiselin, 1963) tried to determine 
criteria for creative performance. He concluded that the problem of criteria 
is very coiiq>lex, and that no single criteria of performance will be accept- 
able or adequate for indicating creativity. He does, however, support the 
hypothesis that productivity is an important ingredient of creativity. In 
his Creativity; Progress and Potential , (1964a), Taylor stresses the point 
that creativity is a quality possessed by all people. He states also that 
"in seeking creative talent, perhaps we are interested in those who have 
fluent bursts of ideas if at the same time they can validly identify the 
best of their own ideas." 
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2.4 L. L. Thurs tone's "Creative Talent" 

In 1950, Thurstone delivered a paper on creative talent to the 
Educational Testing Service Conference on Testing. A great deal of the 
content of that address can be used to provide a theoretical basis for 
the association approach to creativity. A number of his hypotheses are 
listed below: 

• . . creative talent is qualitatively the same at all levels. 

To be extremely intelligent is not the same as to be gifted in 
creative work. This may be taken as a hypothesis. 



A hypothesis that should be considered in the experimental study 
of problem solving is that the moment of insight is often, perhaps 
always, in relaxed and dispersed attention. 

These statements by Thurstone lend theoretical weight to the association 
approach to creativity. He stresses the production of ideas as the primary 
ingredient in creative talent. Granted, it is not the whole story. The 
question still may be asked: how much of the story is it? Thurstone supports 
the hypothesis that creativity is distinct from intelligence though positively 
correlated with it. He thinks that creativity is positively correlated with 
achievement. 



4 

... it is doubtful whether they (referring to the Quiz Kids) ^ 
are also fluent in producing ideas. i 

I 

Although there seems to be seme conflict between scholarship } 
(academic achievement) and creative talent, they are probably i 
positively correlated. i 



. . . this instruction (referring to instruction in the scientific 
method) has little to offer in teaching students how to produce 

ideas. It is this prefocal stage of the process of problem solving 5 

that especially needs investigation. | 

i 

• . . mere fluency of ideas does not adequately represent creative | 

talent. Fluency in seeing implications may be an important char- g 

acteristic of creative ability. Some forms of fluency may signify t 

intelligence without implying creative talent. 4 



I 
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It is worth pointing out that in considering problem solving, Thurstone 
is concerned with the prefocal stage before logic and deduction take over* 
It operates best in a relaxed atmosphere. This is support for the game-like 
and nonevaluative atmosphere in testing. Thurstone adds a seemingly creative 
person to the list provided by Mednick, Thomas Edison. In his autobiography, 
Thurstone stresses Edison's tremendous productivity. "For every experimental 
failure he seemed to produce three more experiments to try." In addition, 
Edison "seemed to have a startling fluency of ideas which often ranged far 
from the problem." 

In general then, there is much in Thurstone's address to support this 
approach which concentrates on productivity. Whether It will prove to be so 
narrow a factor as to account for very little remains to be seen. In fact, 
it will be shown that the factor tapped by the Wallach and Kogan materials 
has an interesting and psychologically interpretable substructure. 

Thurstone* s concluding remarks in his address seem an appropriate way 
to conclude this chapter: 

Experimental studies should be on two major problems, namely, to 
inquire about the nature of the thinking that leads to a mooent 
of insight, and to investigate etq>irically how to differentiate 
creative talent by objective and experimental procedures • It 
is conceivable that we m^ discover how to select people with 
creative talent before we learn much about the nature of that 
kind of talent. 



CHAPTER 3 

THE WALLACH AND KOGAN RESEARCH: PRESENTED AND REANALYZED 

3.1 Introduction 

With the theoretical background presented In the preceding chapter, that 
is, an approach to creativity strongly grounded in association and the con- 
straint of a nonevaluative setting for obtaining the measures, consider the 
Wallach and Kogan study (1965a). 

3.2 The Creativity Tests 

Wallach and Kogan wanted materials that would tap a person's ability to 
produce associations. They wanted materials that would tap this ability in 
a variety of ways. They tried very simple tasks involvi'^g the naming of 
things having a certain property (red, round, etc.), the giving of uses for 
an object (brick, shoe, etc.), the giving of similarities between two dif- 
ferent objects (potato and carrot, train and tractor, etc.), and the giving 
of possible interpretations or meanings for each of a variety of abstract 
visual patterns and line drawings. In essence, then, there were five tests. 
They were administered individually and orally to 151 fifth grade children 
in a New England public school district* The mean age of the students was 
10 years, 8 months. 

3.3 The Measures 

Each item in each test was scored for total number of responses 
(productivity) and for number of unique responses (uniqueness). The total 
number was simply a count of the responses. The uniqueness of a response 
was defined with respect to the sample of children. If a response was 
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given by only one child, it was considered unique* In addition, measures 
of intelligence were obtained using tests from the WISC, SCAT, and STEP 
batteries. The intelligence tests were group administered. 

3.4 Analysis of the Data 

For the five creativity tests, the scores on each item were added together 
to obtain a total productivity score for each test and a total uniqueness 
score for each test. In order to justify this adding of the scores, Wallach 
and Kogan presented the necessary interitem correlations and item-test 
correlations. The complete data are presented in Wallach and Kogan *s Modes 
of Thinking in Young Children (1965a). These procedures will be explained 
in greater detail when the data for the present research are presented. 

In order to justify their claim for a unified dimension distinct from 
the intelligence dimension, Wallach and Kogan presented the three tables 
3.4.1, 3.4*2, and 3.4.3. The average correlation among the creativity measures 
is .41, among the intelligence measures is .51, and between the intelligence 
and creativity measures is .09. Forty-three of the 45 correlations in both 
tables 3.4.1 and 3.4.2 are significant beyond the .05 level. Wallach and 
Kogan considered this good evidence for a unified dimension independent from 
the intelligence dimension. They considered the relatively high correlations 
in the creativity matrix as evidence that the dimension cuts across the verbal 
and visual stimuli. They did not atten?>t to extract factors from the data which 
would have shown this substructure more clearly if it did in fact exist.. 

3.5 Factor Analyses of the Wallach and Kogan Data 

In 1967, James Ward (Manchester University) finally published a factor 
analysis of the total Wallach and Kogan correlation matrix. He used the 



Table 3.A.1 
(Wallach and Kogan) 
Intercorrelations Among the Ten Creativity Measures 
for the Total Sample (N = I51) 
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Note.— For lk9 df, r's of .l6 and .21 are significant at the .05 and .01 
levels, respectively. Decimal points are omitted. 



^rom Ixodes of Thlnklnp; In Young Children: A Study of the Creatlvltv-Intelllgence 
Distinction by Michael A. Wallach and Nathan Kogan. Coovrlght (5)1965 by Holt, 
Rinehart, and Winston, Inc. Reprinted by permission of Holt, Rlnehart, and 
Winston, Inc. 



Table 3.4.2 

(Wallach and Kogan) 
Intercorrelations Among the Ten Intelligence Measures 
for the Total Sample (N = 151) 
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Note.— For ']h9 df, r's of .l6 and .21 are significant at the .05 and .01 
levels > respectively. Decimal points are omitted. 



From Modes of Thinking in YounK Children: A Study of the Creatiyitv-fatelligence 
Distinction by Michael A. Vlallach and Nathan Kogan> Copyrij?ht(c)1965 by Holt, 
Rinehart, and V?inston, Inc. Reprinted by permission of Holt, Rlnehart, and 
Winston, Inc. 
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Table 3. A. 3 
(Wallach and Kcjgan) 
Intercorrelations Between the Ten Creativity and Ten Intelligence 
Measures for the Total Sample- (N = 151) 
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From Modes of Thinking in Young Children; A Study of the Creativity-Intelligenc e 

Distinction by Michael A. VJallach and Nathan Kogan. Copyright (c) 19 65 by Holt> 

Rinehart^ and Winston^ Inc. Reprinted by permission of Holt^ Wfiiehart, and 
Winston, Inc. 
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Promax method of Hendrlckson and White (1964). This method of factor analysis 
Includes obtaining a principal con^onents solution rotated to Varimax crite- 
rion and then powering the matrix of normalized Varimax loadings to obtain a 
criterion matrix of optimal simple structure. The original Varimax factors 
are then rotated to produce the best fit to this "ideal" matrix. The complete 
solution together with the intercorrelations of the factors is given in 
Table 3.5.1. 

Ward interpreted Factor I as a school attainment factor, II as a 
creativity factor. III as a nuuber of responses factor, and IV as a weak 
general factor. In general, his analysis did not shed much light on the 
substructure of the creativity dimension. 

In 1968, Francis Fee (An terlm Education Comnittee) ^Jeclded to apply a 
different factor technique to the Wallach and Kogan data. He used a centroid 
analysis on the creativity and intelligence correlations separately. He 
extracted two factors in each case, hypothesized a simple structure matrix 
on the basis of this analysis, and then factored the entire matrix using 
Horst's Multiple Group Method (1965). Fee's results are presented in 
Table 3.5.2. 

Factors A and B are first order representations of second order factors. 
They were rotated to simple structure on the basis of the hypothesized matrix 
mentioned «bove. Factors I through IV are first order factors, and they 
support the substructure hypothesis rather well. Factor I appears to be a 
"creativity-verbal" factor, and Factor II appears to be a "creatlvlty-vlsual" 
factor. The agreement with Ward's analysis is rather minimal. Ward, in a 
note to the Fee publication, criticizes Fee's use of an hypothesized matrix 
which really prejudges the final result. 
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Table 3.5.1 
( James Ward) 

Factor Structure from Oblique Factorization of Twenty Cognitive Tests 

(Wallach and Kogan, 1965a) 
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Test Factor I Factor II Factor III Factor IV 

1. Instances -uniqueness -O.O56 O.509 -OM^ 0.512 

2. Instances -number 0.110 0.1^72 0.1^7 0.1^59 
5. Alternate uses— uniqueness O.O6I* 0.856 O.OOU 0.218 
1*-. Alternate uses -number 0.175 0-796 0.265 0.200 

5. Similarities— uniqueness ' 0.055 0.772 -O.IO6 0.177 

6. Similarities— number 0.179 O.869 0.150 0.257 

7. Pattern meanings — uniqueness 0.l48 0.655 0.200 0.099 

8. Pattern meanings— number -0.055 0.1*- 18 O.661 0>C^ 

9. Line meanings— uniqueness 0.220 0.717 0.p9jv 0.55^ 
10. Line meanings -rumber 0.09»v 0.7^^2 O.JvlB 0.16^ 



11. Wise vocabulary 
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Intercorrelations of Table Al. Factors 
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12*. wise DictTore arrangement O.IB2 O.16I* 0.001 0.71^9 

15. Wise block design 0.1*1^5 0.057 -0.101 O.opx 

Ik. SCAT— verbal 0.886 O.165 -O.O82 0.262 

15. SCAT-quantitative O.86O O.O98 0.097 0.205 

16. STEP-mathematics 0.851 O.161 -0.182 0.^59 



0.1*-17 



18. STEP-social studies O.887 O.18I* -0.099 0.1^22 

19. STEP-reading 0.859 O.IO8 0.026 O.I76 

20. STEP— writing O.889 O.II6 0.111 0.172 



Reprinted by permission of the British Journal of Educational Psychology . 
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Table 3.5.2 

(Francis Fee) 

Supermatrix of First-Order General Factor Matrix and First-Order 
Rescaled Simple Structure Factors of TVenty Cognitive Tests 
(Wallach and Kogan, 1965a) 
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This is a good example of the difficulties that arise in the use of 
factor techniques, especially when different techniques are applied to the 
same data. Has the imposition of an hypothesized matrix so determined the 
final structure that almost any set of data will appear to have this 
structure when subjected to a similar analysis? This is a problem that 
exists in factor studies, one which is not going to disappear In the near 
future. Individual preferences will have to be tolerated until some agree- 
ment can be worked out among psychologists. 

In the research to be presented, an unrestricted maximum likelihood 
factor analysis (UMLFA) technique developed by Karl JBreskog (1966) is used. 
This method extracts factors in such a way as to give a maximum likelihood 
best fit to the correlations. The factors do not account in turn for maximum 
variance as is the case in the principal components technique. Neither Is 
the fit to the given correlations the best least squares fit. A one factor 
solution in a maximum likelihood technlqiie would be that particular matrix 
which has the maximum likelihood of reproducing the original given correla- 
tions under the assumption of a single normally distributed latent trait 
that accounts for the original behavior. The method also includes a chi-*square 
test of goodness of fit which is dependent on the size of the sample under 
study and the data^s deviation from a multivariate normal distribution. A 
more conqplete description of the UMLFA technique is presented in JBreskog 
(1967b). In order to evaluate the usefulness of this technique, I have 
applied it to the Uallach and Kogan matrix. I will also apply it to the 
data for several other studies to be presented in the next chapter. Tables 
3.5.3, 3.5.4, and 3.5.5 contain the two, three, and four factor solutions 
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Table 3.5.3 

(Wallach and Kogan) 
Maxlinum Likelihood Solution for Two Factors 



Latent Roots 



21.852 11.4i*0 2.270 1.781 1.650 l.kA 1.367 1.22? l.O'S 0.931 
0.852 0 .829 0.781^ 0.69^ 0.672 0.6«*8 o.55lf 0.499 0.1H6 0.372 

Itoique Vaiiances 



1 O.8U0 0.774 0.349 0.349 0.448 0.218 0.668 0.8l4 0 "Wi 0.509 
0.642 0.938 0.82l^ 0.235- O.316 0.349 0.1^12 0 016 0.307 0.21*6 



Varinax-Rotated Factor Matrix 



1. Instances— uniqueness -0.036 ').^8 

2. Instances—number O.O98 C.465 

3. Alternate uses — uniqueness O.OJl O.807 
Alternate uses— number 0.131 O.796 

5. Similarities— uniqueness O.OO9 O.743 

6. Simiiaritiis— number 0.i4l O.873 

7. Patt^irn meanings— uniqueness O.IO8 O.566 

8. Pattern meanings— ntanber -0.033 0.430 

9. Line meanings— uniqueness 0.193 O.609 

10. Line meanings— number 0.059 O.69G 

11. Wise vocabulary 0.589 O.IO6 

12. Wise pictiire arrangement 0.209 0.337 

13. wis: block design 0.420 -0,004 

n^* f^^""""^"*^? 0-871 0.076 

15. SCAT-quantitative q.Q^ 0.023 

16. STEP— mathematic3 O.80O 



0.1(^ 
0.060 
0.091 

20. STFP-vriting -ggg 



18. STEP— social studies o flPi n no' 

19, STEP-reading g.'g;^ ^[f^ 
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Table 3.5.4 
(Wallach and Kogaii) 
Maximum Likelihood Solution for Three Factors 



Latent Roots 



1 2k.^k 11.953 2.70T 1.915 1.750 1.510 lM7 1.501 1.11^6 1.055 
0.951 0.9kl 0.828 0.770 0.725 0.685 0.580 0.558 0.1^65 0.599 



Unique Variances 



1 0.779 0.769 0.^9 0.^6 0.1^55 0.216 0.6^^1^ 0.71^9 0.579 0.1^25 
0.1f91 0.920 0.767 0.255 0.279 0.508 0.511 0.195 0.262 0.165 



Varimax -Rotated Factor Matrix 



1. 


Instances — uniqueness 


-0.055 


0.5*^5 


0.518 


2. 


Instances — number 


0.085 


0.1^75 


0.022 


3. 


i^lternate uses — uniqueness 


0.0* 


0.779 


0.210 


h. 


Alternate uses — number 


0.116 


0.796 


0.080 


5. 


Similarities — \iniqueness 


0.002 


0.705 


0.265 


6. 


Similarities — number 


0.129 


0.81^7 


0.225 


7. 


Pattern meanings — uniquenesr- 


0.095 


0.588 




8. 


Pattern meanings — ^number 


-0.051 


O.J^72 


-0.162 


9. 


Line meanings — tiniqueness 


0.178 


0.625 


0.059 


10. 


Line meanings — number 


0.055 




-0. 126 


11. 


Wise vocabulary 


0.606 




0.575 


12. 


Wise picture arrangement 


0.211 


0.116 


0.li|8 


13. 


Wise block design 


0.1^27 


-0.058 


0.225 


lU. 


SCAT — verbal 


0.870 


0.086 


0.057 


15. 


SCAT — quantitative 


0.821 


0.076 


-0. 202 


16. 


STEP — mathemati c s 


0.806 


0.088 


0.181^ 


17. 


STEP — science 


0.82l|- 


o.oSit 


0.057 


18. 


STEP — social studies 


0.885 


o.o8i^ 


0.126 


19. 


STEP — reading 


. 0.829 


0.07!^ 


-0.2ll^ 


20. 


STEP — writing 


' 0.869 


0.097 


-0.261^ 
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Table 3.5.5 
(Wallach and Kogan) 
MaxiBium Likelihood Solution for Four Factors 



Unique Variances 



1 o.7if6 0.767 o.^k 0.269 0.U35 0.201 0.602 o.ikQ 0.0 0.580 
oMo o.9Ch 0.767 0.235 0.277 0.507 0.309 0.196 0.263 0.166 



Varimax -Rotated Factor Matrix 



1. Instances — uniqueness 0.125 -O.Ohl 0.515 0.370 

2. Instances— number O.O9O O.O87 0.1f66 0.025 

3. Alternate uses— uniqueness -0.019 0.026 O.787 0.3B8 
h. Alternate uses — number -O.O79 0.127 0.81»-2 O.OI7 

5. Similarities — uniqueness O.OrjQ -0.005 0.695 0.28l 

6. Similarities— nvmber O.OO8 0.131 O.859 0.208 

7. Pattern meanings— uniqueness 0.515 O.O92 0.559 O.O56 

8. Pattern meanings — number O.O77 -0.039 O.k^ -0.175 

9. Line meanings— uniqueness Q.Bch 0.155 O.5IO 0.265 

10. Line meanings— number 0.568 0.035 0.695 -O.O57 

11. Wise vocabulary q.COI O.589 0.056 O.klh 

12. Wise picture arrangement 0.102 0.202 O.O9I 0.195 

13. Wise tlock design q^oo6 O.kl^ -0.0lt5 0.2l^2 
Ih. seAT— vertal o.022 0.868 0.07^* O.O76 

15. SCAT— quantitative q 3^7 0.827 0.052 -0.1^^8 

16. STEP— mathematics -0.068 O.8OI 0.097 0.195 

^S'"^"^''^^ . 0.052 0.820 0.065 0.105 

18. STEP— social studies _q qqq q q.^ 0.O76 O.I58 

i?. ccrro 0.857 0.055 -0.169 

20. STEP-writing q.qqs 0.880 O.O78 -0.216 
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using the UMLFA technique* Note that the amount of unique variance in each 
variable after the factors have been extracted is reported. This information 
can be used to determine how much of the variance is accounted for by the 
factors. It also indicates the commonality of the variance being accounted 
for* 

For two factors, the creativity-intelligence distinction is quite clearly 
indicated. Note, however, that measures 1, 2, 11, 12, and 13 have high unique 
variances* This means that they do not share much in common with the tests 
loading high on the two extracted factors* When a third factor is extracted, 
it is pretty much determined by these variables* A fourth factor is difficult 
to interpret. The reason for not arriving at a fairly simple structure is 
that the tests involved do not really form a fairly simple structure* Or 
perhaps, a fairer way to state the difficulty would be that the presence of 
1, 2, 11, 12, and 13 in the battery provide enough additional variation to 
keep the creativity substructure from appearing. In order to test this 
hypothesis, I deleted variables 1, 2, 11, 12, and 13 from the battery and 
submitted the remaining 15 variables to UMLFA. The results were very clear. 
Solutions for two, three, and four factors are given in Tables 3.5.6, 3.5.7, 
and 3.5.8. When two factors are extracted the intelligence-creativity 
distinction is clear. When a third factor is extracted, it clearly shows 
the division of the creativity factor into a "creativity -verbal" factor 
(variables 1-4) and a "creativity-visual" factor (variables 5-8). This is 
a good justification for deleting the Names Test from the creativity battery 
which has been done in several studies* 

Lee Shulman (^966) in a review of their work, has criticized Wallach 
and Kogan for generalizing their results to all young children. They tested 



Table 3.5.6 

(Wallach and Kogan Reduced) 
Maximum Likelihood Solution for Two Factors 



Latent Roots 



1 2oM6 11.156 2.055 1.526 1.576 1.272 1.224 0.956 0.914 0.764 
0.72)+ 0.659 0.589 0.558 0.425 



Unique Variances 



1 o.5*f8 0.555 0.209 0.457 0.816 0.672 0.514 o.6o4 0.240 0.501 
0.568 0.522 ^.255 0.289 0.224 



Varimax-Rotated Factor Matrix 



Alternate uses- -uniqueness 


0.121 


0.798 


Alternate uses — number 


0.019 


0.805 


Similarities —uniqueness 


0.126 


0.880 


Similarities — number 


-0.004 


0.750 


Pattern meanings — uniqueness 


-0.042 


0.427 


Pattern meanings— number 


0.105 


0.565 


Line meanings— uniqueness 


0.054 


0.695 


Line meanings— number 


0.182 


0.602 


SCAT— verbal 


0.867 


0.094 


SCAT— quantitative 


0.855 


0.04l 


STEP— mathematics 


0.786 


0.119 


STEP— science 


0.819 


0.087 


STEP— social studies 


0.870 


0.101 


STEP— reading 


0.845 


0.051 


STEP— writing 


0.879 


0.050 
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Table 3.5.7 
(Wallach and Kogan Reduced) 
Maxiiman Likelihood Solution for Three Factors 



Latent Roots 



1 21.759 15. IB? 2.725 1.692 1.1^50 1.381^ 1-502 1.121 0.999 O.859 

0.758 0.660 0.6118 0.612 0.55i^ 

Unique Variances 

1 0.559 0.566 0.165 0.1^06 0.777 0.606 0.261 0.k72 0.259 O.287 

0.52l^ 0.521 0.226 0.275 0.212 ' 

Varimax -Rotated Factor Matrix 

Alternate uses— uniqueness 0.125 0.66ll- O.lj-50 ^ 

Alternate uses— number 0.024 O.699 0.579 

Similarities --uniqueness 0.151 0.820 0.385 

Similarities— number 0.001 0.715 0.295 

Pattern meanings — uniqueness -0.0^^8 0.259 0.405 

Pattern meanings —number 0.C97 0.508 0.558 

Line meanings— uniqueness 0.057 0.551 0.795 

Line meanings —number O.I72 0-512 0.655 

SCAT— verbal O.867 0.09 5 0.05^^ 

SCAT— quantitative 0.&^ -0.057 0.125 

STEP— mathematics O.796 0.19^^ -0.075 

STEP— science O.819 O.O8I 0.051 

STEP— social studies O.872 O.II8 O.OO9 

STEP— reading O.&^O -0.05ll- 0.126 

STEP— writing O.878 -0.05^^ 0.128 



Table 3.5.8 
(Wallach and Kogan Reduced) 
Maximum Likelihood Solution for Four Factors 



Unique Variances 



1 0.266 0.3^ 0.175 0.581 0.717 O.582 0.572 0.0 0.251 0.288 
0.529 0.515 0.210 0.257 0.181 



Varimax-Rotated Factor Matrix 



Alternate uses— uniqueness 0.021 0.152 O.825 0.IS6 

Alternate uses— number 0.105 0.051 0.795 O.OO9 

Similarities— uniqueness 0.150 0.138 0.886 -O.O67 

Similarities— number O.I89 0.005 0.1^ -0.1212 

Pattern meanings --uniqueness 0.100 -0.01+3 0.ll-07 0.5214- 

Pattern meanings— number O.376 0.09l»- O.li-78 O.I97 

Line meanings— uniqueness O.lj-26 0.014^2 O.608 O.275 

Line meanings— number 0.889 0.155 0.1+51 -0.0^ 

SCAT— verbal 0.01+2 ' 0.868 O.O85 -O.O82 

SCAT— quantitative 0.09O 0.832 O.OO9 0.110 

STEP-mathematics .q.qiI^ 0.795 0.129 -O.I6O 

STEP-science 0,085 O.817 0.061+ .0.075 

STEP-social studies o.035 O.87I+ 0.095 -0.127 

S^P-reading 0.0I+6 0.81+5 O.OO6 O.I7I 

STEP-writing 0.O5I+ 0.881+ 0.022 O.IB8 



only 151 children at age 10 years 8 months. Shulman suggested that a more 
appropriate title for their book would have been "Modes of Thinking in Fifth 
Grade Children." This is a valid criticism. If creativity measures are to 
be relevant to education, as Wallach and Kogan claim they may be, then they 
must be studied at a variety of age levels and tinder different testing 
conditions. What will correspond to a game- like atmosphere in studies of 
college and high school students? Over what range of intelligence will 
the results be reproducible? Since 1965, a number of studies have attempted 
to replicate the Wallach and Kogan results at various age levels. Results 
of these studies will be considered in the following chapter. 



CHAPTER 4 



RELEVANT RESEARCH SINCE 1965: PRESENTED AND REANALYZED 



4.1 Introductiv<n 

A few research studies using the Wallach and Kogan materials have been 
carried out in the last few years. The materials used in each study were not 
exactly the same. William Ward (Educational Testing Service) has used the 
materials in studies with elementary school students. Ward has also begun 
to study a possible quality measure to be obtained from the responses. 
Cropley and Maslany (University of Saskatchewan) have administered the 
materials to two different groups of university students. Wallach and Wing 
(Duke University) have administered the materials to the freshman class at 
Duke. Conditions for administering the materials have included individual 
administration, group administration, and administration by mail. The 

results of these studies are rather consistent. i 

4.2 Research with Elementary School Children ^ 
William Ward (1968a) has administered the Wallach and Kogan materials to : 

two groups of children ranging in age from five to eight years. He deleted ; 

the similarities test from his materials with these young children. In ; 
one group, an intelligence measure was derived from the Block Design and 

Object Assembly subtests of the WISC battery. Intelligence measures for i| 
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the second group were derived from two forms of the Peabody Picture Vocabulary 



The average correlation among the creativity measures is .63. Only one 



Test. Ward's correlation tables are given in Tables 4.2.1 and 4.2.2. 



The results in group 1 (34 boys; mean age 8 years, 2 months) are clear. 
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Table A. 2.1 
(W. C. Ward) 

Creativity Intercorrelations and Correlations with IQ, 

Study 1 (n- = 3*^) 





Measure 


1 2 5 


k 


5 


6 


7 


1. 


Instances -uni quenes s 


.kk .72 


.92 


.59 


.54 


-.08 


2. 


Uses -uniquenes s 


.50 


.42 




.52 


-.u 


5. 


Patterns -uniquenes s 




.76 


.55 


.98 


-.05 


h. 


Instances - flue ncy 






.59 


.80 


-.07 


5. 


Uses -fluency 










-.17 


6, 


Patterns - fluency 










-.u 


7. 


IQ 













Note.— For 52 df, r's of .J*^ and M are significant at the .05 and 
•01 levels, respectively. 



Reprinted by permission of the Society for Research in Child Development, Inc 
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Table A. 2. 2 
(tf. C. Ward) 

Creativity Intercorrelations and Correlations with IQ 

Study 2 



Measure 12 3^56 1 



1. 


Ins t ajtic es - vini que 




.55 


.Ok 


.89 


.66 


-.01 


-.38 


2. 


Uses -unique 


..50 




.05 


.60 


.95 


.05 


-.55 


3. 


Patterns-unique 


.22 


.15 




.13 


.08 


.&k 


.hi 


k. 


Instances- fluency 


.92 


.52 


.21 




.72 


.15 


'.^ 


5. 


Uses -fluency 


M 


.85 


-.01 


.50 




.07 


-.27 


6. 


Patterns -fluency 


.50 


.•50 


.82 


.55 


.15 




.29 


7. 




-.05 


.20 


-.12 


-.01 


.12 


.Oh 





Note'.— Males to right and above diagonal, N = ^1; females to left 
and belov diagonal, N = 46. 



For 59 df, r's of .50 and .39 are significant at the .05 and .01 
levels, respectively. For 1^4 df, r's of .29 and .57 are significant at 
the .05 and .01 levels, respectively. 



Reprinted by permission of the Society for Research in Child Development, Inc 
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intelligence measure was used. The average correlation between the intelli- 
gence measure and the creativity measures was -tlO. The tests had been 
administered at a summer camp, individxially » and in a relaxed atmosphere* 

In Ward's second study (41 boys; 46 girle; mean age 5 years, 9 months) 
the creativity- intelligence distinction was not corroborated. In fact, the 
creativity dimension itself was not determined by the data. The main dif- 
ficulty in this study was that the Patterns Tests correlated very low with 
the other tests. Ward mentions that the nundber of bizarre responses was 
large and that the figural materials are probably not appropriate for children 
this young. This seems to be a reasonable explanation for the data. 

In applying the UMLFA technique to Ward's Study 2 data, a two factor 
solution shows that the hypothesized structure is not present. In fact, one 
would be hard pressed to account for the structure that UMLFA identifies by 
a psychological explanation. Table 4.2.3 gives the UMLFA Two Factor Solution 
for the 41 boys. Table 4.2.4 gives the UMLFA Two Factor Solution for the 46 
girls. A three factor solution for the 41 boys is given in Table 4.2.5. It 
shows that the data break down into a uses factor, a patterns factor, and 
an instances factor. Neither an intelligence factor nor a uniqueness factor 
appears . 

In the case of Study 1, the .98 correlation between the uniqueness and 
productivity measures on the patterns test probably accounts for the fact that 
the matrix is not positive definite. That is to say, it appears that variable 
6 is a linear combination of variables 1 through 5. Thus, all of its variance 
can be accounted for in terms of these 5 preceding variables. The UMLFA 
program uses the inverse of the unique variance of each variable in its 
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Table A. 2. 3 
(W. C. Ward) 
Maxtnum Likelihood Solution for Two Factors 
Study #2 (41 Boys) 



Unique Variances 



1 0.321 0.602 0.0 0.329 0.0 0.140 1.218 

Varimax-Rotated Factor Matrix 

Instances-imique 0.659 -0.032 

Uses-unique 0.949 -0.053 

Patterns-unique 0.108 0.994 

Instances-fluency 0.722 0.052 

Uses-fluency 1.000 -0.029 

Patterns-fluency 0.094 0.835 

IQ -0.257 0.441 
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Table 4.2.4 
(W. C. Ward) 
Maximum Likelihood Solution for Two Factors 
Study 2 (46 Girls) 



Unique Variances 

1 0.136 0.711 0.0 0.023 0.725 0.295 0.985 



Varlmax-Rotated Factor Matrix 



Ins tances-unique 


0.145 


0.918 


Uses-imique 


0.087 


0.531 


Pat terns -unique 


0.997 


0.082 


Ins tances-f luency 


0.130 


0.980 


Uses-fluency 


-0.053 


C.522 


Patterns-fluency 


0.803 


0.'>46 


IQ 


-0.121 


0.010 



Table A. 2. 5 



(W. C. irfard) 
MaxLnum Likelihood Solution for Thre«» r*tui,rs 
Study #2 (41 Boys) 



Unique Variances 

1 0.0A6 0.0 0.2A7 O.f 0.105 0.0 1.037 



Variraox-Rotated Factor Matrix 



Instances -unique 


0.900 


0.126 


0.148 


Uses-unique 


0.389 


0.122 


0.913 


Patterns-unique 


0.075 


0.826 


-0.000 


Instances-fluency 


0,977 


C.165 


0.131 


Uses-fluency 


0.416 


-0.037 


0.759 


Patterns-fluency 


0.1''e 


0.977 


0.123 


IQ 


-0.045 


0.020 


0.236 
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Table 4.2.6 

(tf. C. Ward) 
Maximum Likelihood Solution for Two Factors 
Study #1 



Unique Variances 

1 0.129 0.113 0.348 0.028 0.0 0.971 



Varimax-Rotated Factor Matrix 



Ins tances -unique 


0.189 


0.914 


Uses-unique 


0.902 


0.271 


Patterns-unique 


0.379 


0.713 


Ins tances-f luency 


0.176 


0.970 


Uses-fluency 


0.974 


0.225 


TO 


-0.165 


-0.040 
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iterative procedure. If one variable is a linear coinbination of the other 
variables, the luaximum likelihood technique can not be used directly. This 
is not entirely prohibitive, however. One can eliminate the dependent 
variable and use the UMLFA technique on the remaining variables • This was 
done, and the UMLFA Two Factor Solution for the reduced correlation matrix 
is given in Table 4*2.6. The creativity-intelligence distinction is not 
clear in this case. 

To summarize, the studies of Ward gave partial support to the Wallach 
and Kogan hypotheses. There were difficulties, however, in working with 
very young children. 

4.3 The Cropley Australian Study 

In 1968, A. J. Cropley reported his first study using the Wallach and 
Kogan materials. Cropley tested 124 first year university students, all 
male, with a mean age of 18 years, 4 months. The study was done in Australia 
with the tests group administered but having no inq)osed time limits. In 
addition, five intelligence tests devised by the Australian Council for 
Educational Research were administered. The results are given in 
Table 4* 3*1. 

In^ general, the results support the Wallach and Kogan hypothesis of 
a dimension distinct from intelligence, but the evidence is not a. con- 
vincing as that in the Wallach and Kogan study itself. Notice particularly 
the erratic correlations of the Names Test with the other creativity tests 
in the battery. Cropley presented a factor analysis of his correlation 
data. It is reproduced in Table 4.3.2. Unfortunately, Cropley used a 
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principal components factor analysis and did not rotate the solution. He 
thus retains a general factor in spite of the fact that the intercorrelations 
between the creativity and intelligence tests are very small in comparison 
with the correlations within each domain. His second and third factors are 
bipolar and not very amenable to interpretation in the domain of human 
abilities, I have performed an unrestricted maximum likelihood factor 
analysis of Cropley's correlation matrix with a Varimax rotation. The 
solution for three factors is given in Table 4.3.3. The first factor is 
clearly an intelligence factor. Factors II and III are creativity factors; 
II is the "visual" factor, and III resembles the "verbal" factor with some 
difficulty caused by the Names test. Cropley did not seem to be aware of 
the substructure in the tests, or at least, he does not refer to it. I 
present the four factor solution for completeness sake in Table 4. 3,4. The 
interesting finding here is that on the first factor » the "creativity-visual" 
factor, the Names test loads ver poorly whereas the Uses and Similarities 
tests have moderate loadings. In the present research study, I have followed 
the lead of Wallach and Wing and deleted the Names test. 

4.4 The Cropley and Maslany Canadian Study 

In 1969, Cropley and G. W. Maslany (University of Saskatchewan) adminis- 
tered the Wallach and Kogan materials to 207 Canadian university students, 
of both sexes, and having a mean age of 20 years, 3 months. In this study, 
the authors adm i nistered the tests in an informal group atmosphere • Students 
were allowed to smoke, drink coffee, and move about the room. No time limits 
were imposed. Total times ranged from 1 hour 15 minutes to 6 hours 30 minutes 
(median was 3 hours). In addition, Cropley and Maslany administered six tests 
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from the Primary Mental Abilities battery. In scoring the creativity items, 

the authors did not score for number and uniqueness « Instead, they scored 

for originality, the latter being defined in terms o£ statistical uncommon- 

ness. Scores ranged from 0 for a response occurring on more than 15% of the 

protocols to a maximum of 4 for a truly unique response. This, it seems to 

me, is a reasonable approach. However, it still entails calculating all 

of the percentages of each response. I found this to be an extremely tedious 

and often difficult task as will be explained in the consideration of scoring ' 

the materials in the present research. Therefore, it would have been helpful 

if Cropley and Maslany had continued to use the more or less current system 

of scoring. If the high correlations between uniqueness scores and number 

scores could be verified in a few more studies with the concurrent absence 

of any separate number and uniqueness factors, I think it could be shown that 

the uniqueness score could simply be ignored. Theoretically thi^. may sound 

somewhat damaging as the ordinary concept of creativity seeais to imply this 

certain cleverness that should show up in responses that are unique. Never- 

i 

theless, the empirical evidence seems to show that it adds little to what is l 

I 

already provided by the productivity measures. : 

The correlation matrix for the Cropley and Maslany study is reproduced i 

in Table 4.4.1. Their factor analysis is reproduced in Table 4.4.2. As | 

in the previous study, it allows for rather poor psychological interpreta- ^| 

tion. Realizing this, Kogan, in 1971, refactored the Cropley and Maslany J 

correlation matrix using the Promax method of Hendrickson and White (1964) • | 

I 

I include it in Table 4.4.3 for comparison with the unrestricted maximum like- ;| 

"i 

llhood solution which is given for three factors in Table 4.4.4. The UMLFA 5| 
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Table A. 4.1 
(Cropley and Maslany) 
Means, Standard Deviations^ and Inter correlations 
for All Variables (N - 207) 



1 

k 


5 


6 


7 


8 


9 


10 


11 


70.0 


40.7 


28.1 


21.7 


13.7 


21.2 


11.0 


58. 


32.5 


25.5 




1^.69 


3.88 




3A2 


10. 


321 


267 


168 


084 


155 


lh2 


157 


093 


kjk 


366 


iko 


119 


070 


189 


107 


200 




k23 


038 


Ok3 


-065 


086 


-033 


137 






-026 


027 


017 


082 


-Oli.7 


I6U 






-070 


-027 


-015 


027 


006 


075 








206 


263 . 


1^61 


126 


i64 










280 


h09 


291 


330 












368 


362 


220 














166 


217 
















289 



Variable 



Mean 
S.D. 

1. 

2. 

3. 
h. 

3. 



Names 
Uses 

Similarities 
Pattern meanings 
Line meanings 

6. Verbal meaning 

7. Nuraber facility 

8. Letter series 

9. Word groupings 
10. Niamber series 
U. Spatial relations 



625 h02 



Note. "For 205. df, r's of .1^^ and .18 are significant at the .05 and .01 levels 
respectively. Decimal points omitted in correlation coefficients. 
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Table 4.4.3 

Kogan's Promax Rotation of Crop ley and Maslany's Principal 

Axis Solution (1969) 



Variables 






Factors 








I 


II 


III 


Names 




627 


-068 


350 


Uses 




810 


-049 


272 


Similarities 




801 


-147 


111 


Pattern Meanings 




803 


123 


248 


Line Meanings 




752 


128 


341 


Verbal Meaning 


■ 


-007 


-035 


815 


Number Facility 




-036 


602 


219 


Letter Series 




-082 


549 . 


288 


Word Grouping 




yjDo 


/JO 


00 J 


Number Series 




-066 


743 


-053 


Spatial Relations 




128 


694 


-081 


Note: All decimal 


points are 


omitted. 








Factor 


Correlations 








I 


II 


III 




I 


1.000 


0.124 


0.068 




II 


0.124 


1.000 


0.286 




III 


0.068 


0.286 


1.000 
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Table 4.4.4 
(Cropley and Maslany) 
Maximum Likelihood Solution for Three Factors 



Unique Variances 



1 0.599 0.0 


o.kjk 0.272 


0.222 0.71^5 0.67!^ 0.661 0.567 0.807 


o.8oi^ 






Varimax-Rotated Factor Matrix 




1 


0.587 0.152 0.184 




2 


0.97!^ 0.175 0.11^9 




5 


0.655 0.512 -0.012 




k 


0.5^+4 0.780 0.026 




5 


0.250 0.851 -0.057 




6 


0.085 -0.081 0.1^95 




T 


0.056 -0.005 0.569 




8 


-0.019 0.008 0.582 




9 


0.088 0.058 0.651 




10 


O.0I+9 -0.050 0.1^55 




11 


0.12l^ 0.101 o.hi3 
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technique captures the substructure of the creativity dimension very nicely • 
Factor 1 appears to be a "creativity- verbal" factor, II a "creativity-visual" 
factor, and III an intelligence factor. 

4.5 Wallach and Wing's Duke U n iversity Study 

In 1969, Michael Wallach and Cliff Wing published the results of a study 
they conducted using the Wallach and Kogan materials but de7.eting the Names 
Test. Wallach and Wing mailed the creativity materials to the entering class 
at Duke University and invited the students to participate in the research 
study. About AOZ of the students (302 men, 201 women) agr»»ed to participate. 
They used the Scholastic Aptitude Tests as their intelligence measures* 

Before examining the correlation matrix from their study, it would be 

appropriate to consider several important points that Wallach and Wing stress. 

In defending the use of both uniqueness scores and productivity scores 

(Maslany and Cropley, in their Canadian Study, combined these into one), 

Wallach and Wing reason as follows: 

Recall that we wished to compare the psychological implications 
of ideational output and ideational uniqueness, since the two 
cognitive characterir.txcs suggested different underlying mecha- 
nisms. Hence, an approach was needed that would maximize the 
potential separation between the two. By defining uniqueness 
in terms of the number of fully unique responses, we provided 
as much of an opportunity as possible for the uniqueness count 
to diverge from the measure of total number of ideas produced. 

This seems to be a reasonable theor>, and one which can be checked by extracting 

factors. All of the preceding analyses, and those which will be presented in 

the following, seem to indicate rather clearly that the number-uniqueness 

structure is not nearly as important as the verbal-visual structure. Wallach 

and Wing seem to ignore this point. In extracting four factot& from the 
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creativity correlation matrix for items In my own re8^\:rch, I found that the 
two sub tructuresi verbal and visual, break Jcmi Into uses, slmllarir.las, 
lines, and patterns factors with no evidence of number and uniqueness factors* 

Unfortunately, Wallach and Wing do not report the complete correlation 
matrix for their tests. They state that the correlations between uniqueness 
and number on a single test would be subject to art if actual inflation. It 
v.'uld have been interesting to see if that was the case. At any rate, in 
order to perform a factor analysis of these data, I assumed r^^an the correlation 
between the number and the uniqueness on any subtest v^uld be at least as high 
as the correlation between the number on that subtest and the uniqueness on a 
different subtest. This would seem to be a fair compromise, and, if anything, 
an underestimate of the actual correlation* Of course, the greater this 
correlation, the better will be the chances of finding the substructure that 
has been hypothesized. Thus, for the correlation between nifflib<»r of uses and 
uniqueness of uses I used the correlation between number of xit^H and unique- 
ness of patterns; for similarities, I used patterns; for patterns, I used 
lines; and, finally, for lines, I us?d patterns^ The correlation cable is 
reproduced in Table 4.5.1 with the added correlations underlined. Wallach 
and Wing reported a correlation of .380 between SAT--V and SAT-M. The two 
and three factor solutions are given in Tables 4.5.2 and 4.5. 3. Even though. 
Wallach and Wing have only the two intelligence measures, the structure is 
quite cloar. The fact that taere are eight creativity measures and only two 
intelligence measures results in the creatxvity substructure appearing first. 
In the tvo factor solution, the first factor is the ^'creativity-verbal" 
factor, the second is the "creativity-figural" factor. In the three factor 
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Table 4.5.1 
(Wallach and Wing) 
Correlations and Intercorrelations of Creativity 
and Intelligence Variables 





Variable 


1 2 


5 


k 


5 


6 


7 


8 


9 


10 


1. 


Uses -fluency- 


55 


71 


kQ 


59 


55 


57 


k6 


08 


-02 


2. 


Uses -unique 






51 


57 


1*5 


56 


38 


08 


05 


3. 


Similarities-fluency 






58 


66 


"58 


67 


52 


05 


-05 


k. 


Similar it i es -uni que 








45 


1*9 


56 


57 


05 


-05 


5. 


Patterns-fluency 










66 


79 


66 


05 


-07 


6. 


Patterns -unique 












65 


70 


05 


-05 


I • 


Li ns MscuH ngs — f 1 us ncy 














63 


08 




8. 


Line Mesinings -unique 
















09 


-05 


9. 


SAT-Verbal 


















38 



10 . SAT-Mathemati cal 



Note. --For 501 df, r's of .09 and .12 are significant at the .05 and 
•01 levels, respectively. Decimal points are omitted. 



From The Talented Student by M. Wallach and C. Wing. New York: Holt, Rinehart, 
and Winston, 1969. 
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structure, the intelligence factor appears. The evidence for a uniqueness- 
productivity substructure is weak, certainly much weaker than the verbal- 
figural substructure. 

4.6 Summary 

These studies provide rather good evidence for the intelligence-creativity 
distinction using the Wallach and Kogan measures as the measures of creativity. 
In addition, the evidence for the interpretable substructure appears to be 
fairly good. In the research study to be reported in the next chapter, the 
use of the materials with a high school sample will be tested. The creativity 
measures will also be related to ©any more intelligence and achievement 
measures than have been reported ir; the literature thus far. 



CHAPTER 5 

XAVERIAN HIGH SCHOOL SAMPLE: MEASURES AND HYPOTHESES 



5.1 Introduction 

The studies reviev/ed in the preceding chapters provide rather strong 
evidence that the measures obtained with the Wallach and Kogan materials 
are coherent, have a meaningful substructure* and are independent of at 
least some common measures of intelligence. The materials have been used 
with children between the ages of four and eleven. They have been used 
with college students under two different testing conditions: a relaxed 
group condition in the Cropley and Maslany studies, and testing by mail 
in the Wallach and Wing study. 

In the present research study, the Wallach and Kogan \iiaterials were 
administered to a group of high school sophomores in an attempt to extend 
their use to the middle age level. In addition, many mc neasure"" of 
intelligence and achievement have been added to those reported iu t^revious 
s tudies • 

5.2 Design of the Study 

A variety of factors entered into the choice of tl.a sample to be used 
in this research study. One of the main considerations was to use students 
between the ages of 11 and 18 in order to extend the use of the creativity 
materials. In addition, it was desirable to obtain intelligence information 
on the students. It was felt that such information would be readily available 
at the secondary school level. Accordingly, the principal at Xaverian High 
School in Brooklyn, New York, was contacted by the researcher and clearance 



ERLC 



-•66- 



-67- 



to test students at any level in the school was obtained. The testing was 
to be carried out during the summer or fall of 1969. It was decided that 
the class which would begin its junior year in September, 1969 would be 
the most appropriate ^roup to test for they would take the Preliminary 
Scholastic Aptitude Test at the beginning of their junior year, the National 
Merit Scholarship Qualifying Test in March, and the college board examination 
(SAT) at the end of the junior year. As a result, a good deal of intelli- 
gence information could be gathered. 

The next consideration was whether to administer the tests in school 
or to mail them to the students. It would be difficult to convince high 
school students in a classroom setting that they were to relax and not 
be concerned about the evaluative aspects of the testing. Nathan Kogan, in 
some recent unpublished research, found this to be the case. Therefore, the 
students were tested by mail. It was hoped that this would also allow the 
students more freedom in deciding whether or net to participate in the study. 
This freedom to participate probably accounts for the fact that those students 
who ^id participate filled out the materials seriously. Obscene, vulgar, 
and bizarre responses were virtually nonexistent. 

Once the decision to test by mail was made, it was decided that a summer 
testing would be more apt to keep the students from sharing responses. 
Xaverian High School's student body comes from a large geographical region 
in New York City. The summer mailing was about as good a control over sharing 
responses as could be attained. 

Thus, the original design of the study was to test during the summei. of 
1969 as many of the Xaverian High School sophomores as would volunteer to 
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participate in the study. If a sufficient number agreed to participate, the 
intelligence measures would be obtained at a later date from the school. 

5.3 Instruments and Procedure 

In August of 1969, the Wallach and Kogan materials were mailed to the 
homes of the 371 sophomores. The students were informed that, with the 
principal's permission, they were being asked to participate in a research 
study of some new educational materials. They were assured that their 
responses would be kept strictly confidential. In addition, they were told 
that the researcher would visit the school during the course of the year to 
explain the research further and to invite them to continue their participa- 
tion. Subsequently, this was done. The students were asked to return the 
materials by August 31st. One hundred forty students returned the materials 
completed and volunteered to participate in the research study. 

During the next few months it became evident that the scoring of the 
140 tests would be a rather formidable task. It was decided to select a 
random sample of 40 students for a preliminary analysis. Using these 40 
students and the Preliminary Scholastic Aptitude Test administered in Octjber 
1969, a preliminary analysis was performed and reported in the Minor Research 
Report A Validation of the Creativity-Intelligence Distinction in H igh School 
Sophomores (June 1970). The preliminary analysis was encouraging, and the 
decision was made to analyze the data of all 140 students ard to gather other 
available intelligence and achievement information. The actual measures used 
in the total study will be described in the following sections. 
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5.4 The Creativity Measures 

The actual materials sent to the high school students are reproduced in 
Appendix 1, The items are taken from the original Wallach and Kogan materials 
(1965a) and comprise four tests: a Uses Test, a Slmi^-*rities Test, a Pattern 
Meanings Test, and a Line Meanings Test. Each test contains three items. 

Two scores are obtained for each item, a productivity score and a 
uniqueness score. The productivity score is simply the number of distinct 
responses given for an item. A unique response is one that is given by 
only one subject in the sample. The uniqueness score for aa item is the 
number of unique responses given for that item. While the productivity score 
is obtained easily, the uniqueness score presents a number of difficulties. 
The actual procedure used in this study for the productivity scores was to 
reproduce two sets of the studait materials and have independent scorers score 
them. Disagreements were resolved by the author usually in favor of the 
higher score. Since the students were directed to give distinct responses, 
this seemed to be a reasonable approach. Unique scores were determined by 
the author with assistance from several students in psychology. In general, 
the following principles outlined h[, Wallach and Wing in The Talented Student 
were used in the scoring: 

(1) Different terms which have the same meaning are considered to 
be the same. For example, "toy" and "plaything" are categorized 
as the same use for a shoe. 

(2) Singular and plural responses are considered to be the same 
in the case of the verbal items. For instance, "line garbage 
can" and "line garbage cans" are categorized as the same use 
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for a newspaper. In the case of the visual Items, on 
the other hand, singular and plural responses are not 
considered to be the same because different images are 
Involved: the student envisions a different percept in 
each case. 

(3) Such phrases as "part of," "piece of," or "article of," 
are treated as irrelevant when tuey refer to a collective 
concept. For example, "piece of string" and "string" are 
categorized as the same response for the second item in the 
line meanings task. The aforementioned kind of phrases are 
retained as meaningful, however, when they refer to a dis- 
crete concept, because different images are envisioned. For 
instance, "part of a racetrack" and "racetrack" are categorized 
as different responses for the second item in the pattern 
meanings task. 

(4) References to the position of the viewer are treated as 
irrelevant. For instance, "upside-down vase" and "vase" 
are classified as the same response for the third item in 
the line meanings task. 

(5) Qualifiers representing varying degrees of endorsement are 
considered to be the same. For example, in relation to 
similarities betx^een a potato and a carrot, the following 
responses are taken as equivalent: "always peeled," 
"usually peeled," "often peeled," "normally peeled," 
"sometimes peeled," and "peeled." Aaalogously, qualifiers 
representing varying degrees of nonendorsement are considered 

erJc 
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to be the same. For instance, the following responses 
are taken as equivalent similarities for train and tractor; 
"never colored white," "seldom colored white," and "not 
colored white." 

The means, standard deviations, high and low scores, and the identifying 
number of the students obtaining the highest scores are listed in Table 5.4.1 
for each of the 12 items. The reason for including the student with the 
highest score will be apparent from the discussion in the next section. 

5.5 The Problem of Student Number 100 

After the raw creativity scores were obtained, the correlation matrix 
shown in Table 5.5.1 was computed. These correlations were sufficiently 
high to indicate good item-item, interrelationships and to justify adding 
the items on a given subtest together. In order that each item would con- 
tribute equally to total scores, all item scores were standardized with a 
mean of zero and a standard deviation of one. When these standardized scores 
were examined, it was immediately evident that the scores of student number 
100 were extremely deviant. It can be seen from Table 5.4.1. that student 
number 100 scored higuc.st on 22 of the 24 creativity mea'^ures. In reexamining 
the original test for student number 100, it was foun^ that his scores were 
correct. They were simply very deviant. The actual standard scores for this 
student were more than four standard deviations from the mean on every measure 
and more than nine standard deviations on ten of ube measures. Since the 
sample size is 140, the effect of st..dent nv'-iber 100' s scores on the entire 
data is not immediately evident. 



-73- 



in 



V) 

in 
o 



CO 
CO 

o 



fM 



»4 



s: 



CO 



CO 
CO 



CO 
CO 
CO 



CO 
CO 

& 
& 



CN 

H 
CO 



at; 



in r* ^ NO \c«min^\oo^^^^*oi»wr*tnr* 



r•r•r>r•a*^fnr*l^^oo<^o^^▼-^of>4%ooor^^n:to 
t^vomi^vo^^in^ininvoovovoc^r^r^vo^nvomr* 



tc tf^O(nc^ooC>^«>^^oococo^c<C\cc&ocoo^^(*)cor^o^ 
H 

c*> m in 1^ r* 1^ so \ou>cooeom*nin^c\c^\oiy'nr*(cr* 



CO M r* « in ^ oc o :» o CMn *o CO CD \o *^ ^ m o\ 

:c fnm^oocooovcr^voooooo inininr^p^r^^innoof^?^ 

H r- 

^invcvooi^i^ocoo^ovo-a^jinininvo^r^^ininvo 



^ NO in O" c- ,-»co^oo^(7^^\cvoorcco^^\c9oo^ao 



to vror^vc^o*ov£>v£5inir.m\ovcf^vci/'rinsc\oinroin:i4r 
co 



O 



I 



u 

03 

1^ 



4J 

<0 
0) 

o 

CI 

•g 

0 



I 



in 



T- <M « m r- c'v m eg m ^ M fn 




7i SB »' 



O 
CO 

o 



-74- 
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In order to determine whether or not the scores In question would 
inordinately distort the results of this study, several factors were 
considered. First of all, it is desirable to jusliify adding the 3 /jre«< 
on individual items together in order to obtain total scores on subtests* 
High interitem correlations are ordinarily used as evidence for the reason- 
ableness of this process. In addition, the substructure of the creativity 
dimension would be determined by factor analyzing the correlation matrir. 
Therefore, the correlations are the primary data to be analyzed ia this 
research study. What effect vould one student's scores have on the correla- 
tion coefficients in the study? The answer to tbJLs question was used to 
jUgtify the decision to delete student number lOO^j scores from the data 
before proceeding. N^eertheless, In ApperiJix 2, a two factor UMLFA soluti 
for N » 140 is pre^>jnted for comparison. 

. 6 Influence of a Jevlant Score the Correlation CoefficieP ^' 

There is no absolutely agreed upoa critsrion for deleting a deviant score 
from a set of data. However, there are ways of assessing its effects. In 
this section, three approaches will be considered to justify deleting studen*: 
number 100'-. scores frou the data before proceeding: 

(1) Consideration of the s catter plots of the data 

(2) Consideration of the variance in the data 

(3) Consideration of the changes in the correlation coeff iclent«3i 
when IflOO is deleted. 

(1) The scatter plots for several measures are given in Figure j 5.6.1 
through J. 6. 4. Each scatter plot resembles a case in which many scoirss are 
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close to the origin and one score is large. In order to demonstrate the effect 
of a deviant score on data like this, consider the following case. Suppose 
that four students score as follows on two items: (1, 1), (1, 2), (2, 1), and 
(2, 2). The mean score on each item would be 1.50, the standard deviation 
would be .58 and the correlation is zero. Now, if a fifth student scored 
(10, 10), the mean would become 3.20 and the standard deviation 3.83. The 
correlation coefficient would become .98. That such a large change occurs 
is probably not surprising since the one student in only five would seem 
rather critical. Now, assume that instead of one student receiving each of 
the (1, 1), (1, 2), (2, 1), and (2, 2) scores, 50 students receive each of 
those scores, thus raising the N involved to 200 students. What would be 
the effect of one student receiving a score of (10^ 10) on the two items? 
For N = 200, the mean, standard deviation, and correlation coefficient 
would still be 1.50, .58, and 0.0, -"-espectively. With N » 201, the mean 
would be 1.54 and the standard deviation .78. At face value these changes 
may seem rather small. Nevertheless, the correlation coefficient would now 
be .59. For an N of 201, this value is significantly different from zero. 
Yet it is a spurious value. A scatterplot of these data would look like 
Figure 5.6.5. 
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The scatterplots given In Figures 5.6.1 through 5.6.4 Indicate that the 
data In this research are similar to that given in this example. The scatter- 
plots with student number 100 deleted are given in Figures 5.6.6 through 
5.6.9. 

(2) Harold Gulllksen (Theory of Mental Tests, 1950) and Qulnn McNemar 
(Psychological Statistics, 1962) give the following equation relating the 
correlation between two variables in a curtailed sanq>le with the correlation 
of the two variables in the uncurtailed sample and the standard deviations 
in both samples: 



R 
xy 



'xy (sd J 



/l-r^ .r^ (^Y 
V xy xy \Bd^l 

where R » correlation with uncurtailed range, 

r « correlation with curtailed range, 
xy 

SD^ » standard deviation with uncurtailed range, 
sd^ « standard deviation with curtailed range* 

It is evident from this fomula that the ratio of the standard deviations is 
an important factor in accounting for the change in a correlation coefficient 
when the range of the variables is curtailed. Ordinarily, the deletion of 
a single score will not cause a very large change in the *atio of the standard 
deviations. In the data at hand, however, the deletion of the scores of 
student number 100 causes rather large changes it. the ratio of the standard 
deviations (see for example NPATl for N » 140 and N - 139). This provides 
further justification for deleting number lOO's scores from the analysis. 
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(3) Finally, what in fact is the effect of deleting the scores of student 
^number ICO from these data? A set of means, standard deviations, high and low 
scores, and the nuaiber of the student scoring highest is given in Table 5, 6. 11 
for N « 139. Note that the change la standard deviation is quite significant 
in the sense explained above* In addition, the distribution of students 
receiving the hi.ghest scores on the various items Is more reasonable* A set 
of the new standard scores for N » 139 Is given in Table 5.6.12. No scores 
are grossly deviant in this instance. 

The correlation matrix for N « 139 is given in Table 5.6.13. By com- 
paring Table 5.5.1 with Table 5.6.12, It can be seen that the correlations 
have decreased markedly. The graph of tb3 correlations given in Figure 5.6.10 
shows this clearly. Confidence intervals were also computed for the 276 
correlations in each table. For N « 140, every correlation is significantly 
different from zero at the .01 level. For N » 139, 220 correlations are 
significant In each table. For N » 140, every correlation is significantly 
different from zero at the .05 and .01 levels. For N » 139, 220 correlations 
are significant at the .01 level and 251 at the .05 level. It was decided 
therefore that th.^ correlations for N » 139 should be used in the remainder 
of the study. These data should be weaker than the data for N » 140 in the 
sense of giving positive evidence for the coherence of the rreativity dimension. 
In the case of the factor analysis for the identification of substructure, the 
data for N « 139 will probably be better. Uniformly high correlations due to 
one student 'is scores might mask the underlying structure in the data. However, 
.for comparison, a factor analysis ±q presented in Appendix 2 for N « 140. 
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5.7 Measures of Ability 

In addition to the measures of creativity described above » a number of 
intelligence measures were also obtained for the students Involved in the 
study* Although a number of the intelligence measures are probably rather 
closely related, it was decided to simply use all of the Information that 
could reasonably be gathered for the sample. In the Duke Study, Wallach 
and Wing's aim (The Talented Student , p. 29) was to obtain a single best 
estimate of each student's general intelligence. In this study, however, 
using the factor analytic technique, it is better to retain the measures in 
their pure state and let the analysis identify the structure. A rather good 
supply of Intelligence Information was available at the school. The National 
Educational Development Tests (NEDT) and the National Merit Scholarship 
Qualifying Test (NMSQT) have been distinguished from other measures as 
standardized measures of achievement. If this is not reasonable, the factor 
analysis will indicate it. 

Since these measures were obtained from the school, there are a moderate 
number of missing scores. Some students were absent on days that particular 
tests were administered; some students withdrew from the school during the 
course of this study. In every case, the attempt was made to use as much of 
the available Information as possible. The means, standard deviations, high 
and low scores, and the actual number of scores available for each variable 
are given in Table 5.7.1. In the analysis, the scores of student number 100 
were deleted. The name of each variable is identified t>elow by giving the 
name of the test score used, the date on which the test was administered, and 
the acronym used in the computer programs to identify the variable. 
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1) 


May 1967: 


HENMIQ 


- Henmon-Nelson IQ Test 


2) 


Oct. 1969: 


PSATV 


- Preliminary Scholastic Aptitude Test (Verbal) 


3) 


Oct. 1969: 


PSATM 


- Preliminary Scholastic Aptitude Test (Math) 


4) 


May 1970: 


CTMM 


- California Test of Mental Maturity 


5) 


May 1970: 


SATVl 


- Scholastic- Aptitude Test (Verbal) 


6) 


May 1970: 


SATMl 


- Scholastic Aptitude Test (Math) 


7) 


Nov. 1970: 


SATV2 


- Scholastic Aptitude Test (Verbal) 


8) 


Nov. 1970: 


SATM2 


- Scholastic Aptitude Test (Math) 



These tests are conmonly used Intelligence and aptitude tests, and descriptions 
of the© can be found in many standard texts on testing. 

5.8 Standardized Measures of Achievement 

In addition to the measures described in section 5.7, measures on the 
NEDT and the NMSQT were available for most of the students in the study. 
The name of each variable is identified below by giving the name of the test 
score used, the date on which the test was administered, and the acronym used 
in the computer programs to identify the variables. 



1) 


Mar. 


1968: 


ENGl 


- NEDT 


(English Usage) 


2) 


Mar. 


1968: 


MATHl 


- NEDT 


(Mathematics Usage) 


3) 


Mar. 


1968: 


SOCSTl 


- NEDT 


(Social Studies Reading) 


4) 


Mar. 


1968: 


NATSCl 


- NEDT 


(Natural Science Reading) 


5) 


Mar. 


1968: 


WORDUl 


- NEDT 


(Word Usage) 


6) 


Feb. 


1969: 


ENG2 


- NEDT 


(Englieh Usage) 


7) 


Feb. 


1969: 


MATH2 


- NEDT 


(Mathematics Usage) 


8) 


Feb. 


1969: 


S0CST2 


- NEDT 


(Social Studies Reading) 
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9) 


Feb. 


1969: 


NATSC2 


- NEDT (Natural Science Reading) 


10) 


Feb. 


1969: 


W0RDU2 


- NEDT (Word Usage) 


11) 


Mar. 


1970: 


ENG3 


- NMSQT (English Usage) 


12) 


Mar. 


1970: 


MATH3 


- NMSQT (Mathematics Usage) 


13) 


Mar. 


1970: 


SSTNSC3 


- NMSQT (Social Studies and Natural Science Reading) 


14) 


Mar. 


1970: 


W0RDU3 


- NMSQT (Word Usage) 



Descriptive material on these tests can be found In standardized texts on 
testing. Means, standard deviations, high and low scores, and the number of 
actual scores available for each variable are given in Table 5«8.1« 

5.9 School Measures of Achievement 

In addition to the measures of creativity, intelligence, and standard 
achievement, an attempt was made to obtain student grades* After examining 
the curriculum and student schedules, it was decided that useful information 
could be provided by comparing student grades in English, mathematics, science, 
and social studies. These grades were available for substantial numbers of 
students. In addition, the student's overall average for grades 9, 10, and 
11 was available and used. This average is a three year cumulative average 
computed by the school for all academic subjects taken by the student* While 
this measure is in large part determined by the subjects listed above, it is 
not necessarily totally determined by them. The extent of determination should 
come out in the analysis of the data. The name of each variable is identified 
below by giving the name of the course, the grade when appropriate, and the 
acronym used in the computer programs • 
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1) 


6KADE 


9: 


ENGGR9 


- English Trade 9 


2) 


GRADE 


10: 


ENGGRIO 


- English Grade 10 


3) 


GRADE 


11: 


ENGGRll 


- English Grade 11 


4) 


GRADE 


9: 


MATHGR9 


- Mathematics Grade 9 


5) 


GRADE 


10: 


HAIHGRIO 


- Hathematics Grade 10 


6) 


GRADE 


11: 


MATHGRll 


- Hathematics Grade 11 


7) 


GRADE 


9: 


BI0L9 


- Biology (usually Grade 9) 


8) 


GRADE 


10: 


SCGRIO 


- Chemistry, Physics, or Earth Science 



9} W0RGE06 - World Geography (various grades) 

10) WORHIST - World History (various grades) 

11) USHIST - United States History (various grades) 

12) AVER Cumulative three year average 

The means 9 standard deviations » high and low scores, and the number of 
actual scores available for each variable are given in Table 5.9. 1. 

This summarizes the measures that were actually obtained for the students 
in the study. 

5.10 Hypotheses 

Although the variors hypotheses to be tested in this study have been 
indicated in several previous sections ^ they will be restated here for 
reference. 

I. There exists an Identifiable and measurable dimension of human behavior 
fairly called creativity . This hypothesis can be verified by demonstrating; 
that a set of measures can be obtained which have high interitem correlations 
and item-test correlations. The measures should be reliable. This would be 
good verification that ''something'' has been measured* To demonstrate that 



-101- 

tie -'something" Is creativity is more difficult. In thia study, the Justifl- 
cation is not statistical but theoretical (Qiapter 2). It is, of course, 
assumed that writing down many ideas corresponds to having many ideas, and 
it is this behavior that is thu criterion for the measures. High scores in- 
dicate fluency and uniqueness in generating "ideas" related to uses of things, 
•Imilarities betweien chings, and meanings of patterns and line drawings. 

II* The dimension o f creativity is independent of the coomion dlnenslon 
of intelligence . Tills hypothesis should be verified by first verifyiag the 
existence of the intelligence dimension by suitable measures. Then, if the 
two dimensions are independent, they should be relatively uncorrelated. In 
this study, in addition to examining the average correlations, the correlations 
will be factor analyzed. If creativity and Intelligence form independent 
dimensions, the factor analysis will yield relatively independent factors 
underlying the data. 

III. The dimension of creativity has a meaningful substructure ^ This 
hypothesis will be verified by showing that the creativity data yield a 
two-fold factor structure that can be related to the verbal and visual 
stimuli in the materials. The extent of relationship can be determined by 
an oblique transformation of the underlying factors^ In addition, exami- 
nation of the factor structure of the creativity and Intelligence data may 
provide serendipitous conclusions, for example relationships between the 
two creativity factors and the mathematics and verbal factors of intelligence. 
An arbitrary hypothesis that the creativity factors are less independent of 
the verbal Intelligence factor than the matheoatical factor can be verified 
by examining the factor structure in some detail. 
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IV > The dimensions of creativity and school achievement are not 
independent • This hypothesis can be verified by checking the significance of 
the correlations between creativity and school achievement with intelligence 
held constant. Without a single measure of achievement, it may fairly be 
expected that the factor study will provide evidence for differential relation- 
ships of creativity to school grades. At any rate, examination of the factor 
structure for all the variables in the study may provide sufficient evidence 
for a conclusion to be drawn about the relationship between creativity and 
achievement. One of the disputed conclusions of Getzels and Jackson was 
that creativity does influence grades apart from intelligence. 

To suimnarize, thei, the creativity measures will be examined alone, then 
together with ability only, then together with achievement only, and finally, 
with intelligence and achievement together. 



CHAPTER 6 

XAVERIAN HIGH SCHOOL SAMPLE: REDUCTION AND ANALYSIS OF THE DATA 



6.1 Introduction 

In this chapter, the data will be examined for evidence to confirm or 
deny the hypotheses of Chapter 5. There Is no single way to present evidence 
that will be acceptable to every reader. In this case, the data will be 
analyzed using the UMLFA program as It was used In examining the data 
presented in Chapter 4. 

6.2 The Creativity ^asures 

According to the theory of Wallach and Kogan, the creativity measures 
should cohere. In order to show that th^ do, the interitem correlations 
are presented in Table 5.6.13. It can be seen that the evidence for the 
internal consistency of each task is good, i.e., a person generating many 
ideas on one item of a given task also tends to generate many ideas on the 
other items of the task. Correlations from Table 5.6.13 are regrouped below 
to make this point clear. 

CORRELATIONS AMONG PRODUCTIVITY SCORES ON EACH OF THE FOUR TASKS 



Item Pattern Line 

Pairs Uses Meanings Similarities Meanings 

1 vs. 2 .596 .813 .795 / .732 

1 vs. 3 .5^3 .777 .674 f .674 

2 vs. 3 .718 .748 .788 .710 



Similarly, the correlations in Table 5.6.13 present fair evidence for 
the consistency of the uniqueness tasks, i.e., the person who generates many 
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unique ideas on one item of a given task also tends to do so on the other items 
of that task. The correlations among the uniqueness scores for the four tasks 
are regrouped below for clarity* With the exception of the uniqueness scores 

CORRELATIONS AMONG UNIQUENESS SCORES ON EACH OF THE FOUR TASKS 



Item 




Pattern 




Line 


Pairs 


Uses 


Meanings 


Similarities 


Meanings 


1 vs. 2 


.133 


.475 


.621 


.506 


1 vs. 3 


.280 


.603 


.707 


.349 


2 vs. 3 


.270 


.457 


.777 


.493 



for Uses, the item-ltem correlations are sufficiently high to justify adding 
the scores of the items to obtain the best measure for each subtest. Accord- 
ingly, the standard scores for each item were added to provide eight test 
scores. Since there were only three items to a test, the correlations of 
the items with the test sum will necessarily be high. In addition, the 
reliability for a single test cannot reasonably be calculated with only three 
items in a subtest. However, using all 24 measures of creativity together, 
a split-half reliability seems to be a meaningful statistic to report. Using 
every other measure and the Spearman-Brown correction formula, the reliability 
of the 24 measures considered as a single test is .91. Thus, the measures do 
appear to cohere and to identify a distinct domain. 

6.3 Comparisons of the Data Obtained in Two Studies Using Testing by Mall 
One of the misgivings involved in using the testing by mail technique 
Is the lack of control that one has over the subjects. One student may 
spaid several hours on the tests while another may spend only several minutes. 
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The itiq)licit assumption seems to be that a student will work at some pace 
determined by himself. He will stop on an item when his fund of ideas is 
more or less depleted. Naturally there is a trade-off between the amount 
of time a student will spend and the number of ideas he will generate. 
Probably he could go on generating for days, but the output would be so 
slow that the effort would be painful. At the other extreme, a student may 
try to speed through the entire set of materials in fifteen minutes. Since 
he need not take the test at all, it would seem that the volunteer would 
give enough time to do a reasonable job and yet not so icuch time as to be 
terribly inconvenienced. This, it seems to me, is a possible explanation 
for the rather surprising agreement found between the means and standard 
deviations in the Wallach and Wing Study and the Xaverian High School Study. 
Although the researcher cannot control the testing conditions, there is a 
rather natural control built in. In addition, one is tempted to hypothesize 
that a cognitive ability to generate ideas on these simple tasks not only 
exists in the population, but that it exists with a somewhat stable mean 
and variance. This is a serendipitous result which of course may simply be 
an accident. At any rate, the means and standard deviations for the two 
groups are given in Table 6.3.1 for consideration. 

6.4 Meaningful Substructure 

In spite of the seeming triviality of these Wallach and Kogan tasks, they 
seem not only to define a meaningful dimension, but this dimension appears to 
possess a meaningful substructure similar to the verbal and mathematical sub- 
structure of intelligence measures. This substructure can be most clearly 
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Table 6.3.1 

Productivity Measures 

Wallach and Wing Study Xaverlan High School Study 







Standard 




Standard 




Means 


Deviation 


Means 


Deviation 


Uses 


28.07 


16.81 


30.27 


19.70 


Pattern Meanings 


15.63 


10.98 


15.27 


9.80 


Similarities 


19.35 


11.15 


19.82 


11.80 


Line Meanings 


16.29 


9.65 


16.64 


8.91 




Uniqueness Measures 








* Wallach and Wing Study 


Xaverlan High School S 






Standard 




Standard 




Means 


Deviation 


Means 


Deviation 


Uses 


2.21 


4.09 


1.84 


2.56 


Pattern Meanings 


5.19 


5.84 


3.74 


4.17 


Similarities 


1.02 


1.94 


1.71 


3.61 


Line Meanings 


2.96 


3.99 


3.42 


3.86 
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demonstrated by performing the imrestricted maximum likelihood factor analysis 
as was done In the studies reanalyzed In Chapter 4. Two, three, and four 
factor solutions will be presented. The two factor solution clearly shows 
the underlying flgural and verbal dimensions. The thr..a and four factor 
solutions show that the measures break down according to single tests and 
do not seem to possess a uniqueness factor Independent of the productivity 
factor. Since the uniqueness scores are very time consuming to obtain, this 
could be a rather lii5>ortant conclusion. The two factor structure Is given 
In Table 6,4. 1. As was pointed out In Chapter 4, this Is the best two factor 
solution In the sense that of all two factor solutions this solution has 
the highest probability of reproducing the correlation matrix under the 
assumption of two normally distributed latent traits. The result is quite 
clear. The flgural items and the verbal items have differential loadings 
on the two factors. Of course, since this is an orthogonal solution, the 
relatively high loadings of the verbal items on the flgural factor and of 
the flgural items on the verbal factor indicate that the two factors are 
correlated. Using a promax transformation, the correlation between the 
two factors can be shown to be .334, The t^iree factor solution in Table 
6,4,2 shows that the flgural factor breaks down first into the line meanings 
and the pattern meanings. The four factor solution in Table 6.4.3 shows 
that the two factors will break down along meaning lines, i.e., the four 
subtests, and there does not appear to be a distinct uniqueness factor. 
This corroborates the point made in the reanalyses of Chapter 4. 

In order to obtain total scores on the various subtests, all the measures 
were transformed to standard scores. That is to say, for each of the 139 
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scores for a particular Item, that score was subtracted from the mean, and 
the difference was divided by the standard deviation of the scores. The 
result is a score distribution with a mean of 0 and a standard deviation 
of 1« Then the three standard scores for each task were added to obtain 
a score for that task. Thus, the final result is a set of eight creativity 
scores: four productivity scores, and four uniqueness scores. The corre- 
lations among these, together with 99% confidence intetvals, are given in 
Table 6.4.4. 

6.5 Independence of the Creativity and Intelligence Dimensions 

Using the eight creativity measures and the eight ability measures 
described in Chapter 5, an unrestricted maximum likelihood factor analysis 
was performed on the correlations of these 16 measures. The correlation 
matrix is given in Table 6.5.1. The results for 2, 3, and 4 factors are 
given in Table 6.5.2, 6.5.3, and 6.5.4. The two factor solution gives rather 
clear evidence for the independence of the creativity and intelligence dimen- 
sions as defined by these tests and in this particular sample. The three 
factor solution shows two intelligence and one creativity factor, the 
intelligence factor having broken down into a verbal and a mathematical factor. 
The four factor result gives the clear four frctor structure that one would 
expect from these measures. The first and fourth factors are verbal and mathe- 
matical ability factors, the second factor is a figural ''creativity*^ factor, 
and the third factor is a verbal ''creativity" factor* The correlations between 
the "creativity" factors and between the verbal and mathematical ability factors 
are .473 and .115 respectively. 
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6.6 The NEDT Measures 

In every analysis, the NEDT measures loaded high on the ability factor. 
No standard achievement factor was ever obtained. This will be clear when 
the correlation matrix of all variables is factored. 

6.7 Creativity and Grades 

One of the hypotheses was that the creativity dimension and the grades 
dimension were moderately correlated. The correlation matrix for grades and 
creativity variables is given in Table 6.7.1. An UMLFA of t e creativity and 
grades correlations was performed. The results for two and three factors are 
given in Tables 6.7.2 and 6.7.3. The results indicate quite independent grades 
and creativity factors. 

To provide some evidence, however, for the relationship between creativity 
and grades, a coii?>rehensive 35 variable correlation matrix (Table 6.7.4) was 
analyzed. This matrix included the eight creativity measures, the elgjit 
ability measures used above, the NEDT measures, and nine of the grades. 
Several of tha va-'-iables were deleted to make the correlation matrix positive 
definite. The factor structures for 2, 3, 4, 5, and 6 factors are given' in 
Tables 6.7.5 through 6.7.9. The two factor solution seems to indicate a mod- 
erate degree of relationship between creativity and grades • The first factor 
can be interpreted as an ability factor with high grade loadings in addition. 
The second factor can be interpreted as the creativity factor with some moderate 
grade loadings. To clarify the data, consider the three factor solution. The 
intelligence, creativity, and grades factor are clearly distinguished. A 
promax transformation to simple structure would give the correlations between 
the factors, an indication of their interrelatedness. The factor correlations 
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can also be four»d by the new ACOVS (Analysis of Covariance Structure) approach 
of JBreskog, The promax rotation gives correlations between intelligence and 
creativity of .OCSy between Intelligence and grades of .AS?, and between grades 
and creativity of The four factor solution shows the breakdown of the 

Intelligence factor Into verbal and matheaatlcal components; the five factor 
solution shows the breakdown of the creativity factor luto flgural and verbal 
components* Further solutions show the creativity factors further dividing 
Into Uses and Similarities factors. 

These data clearly show that the creativity Items define a dimension, 
that the creativity dimension Is Independent of Inte.lllgence, and that the 
Intelligence and creativity dimensions are independently related t;o the 
grades dimension, the Intelligence being more close \y related which, of 
course, was expected. 

6.8 Analysis by Regression 

In addition to the analysis presented thus far, these dat-^ can also be 
examined using a regression technique. The existence of the three dimensions 
of creativity, intelligence, and school achievement has been demonstrated by 
the factor analysis. In the regression, eight variables will he used to 
define each as listed below; 



Creativity 

Uses-number 

Pat tems-nuniber 

Siailarities-numbei 

Lines-number 

Us es- un 1 quenes s 

Patterns-uniqueness 

Similarities-uniqueness 

Lines-uniqueness 



Intelligence 

PSAT Verbal 

PSAT Mathematical 

SAT Verbal 1 

SAT Mathematical 1 

SAT Verbal 2 

SAT Mathematical 2 

am 

Henmon-Nels on 



School Achievement 

English Grade 9 
English Grade 10 
English Grade 11 
Mathematics Grade 9 
Mathematics Grade 10 
Mathematics Grada 11 
Biology Grade 9 
Science Grade 10 
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All scores were standardized with a mean of zero and a variance of one in 
order to give equal weight to each score. Total scores were then obtained 
by adding the individual scores in each diisension. A set of total scores 
for N = 139 is given in Table 6.8.1. 

Using tha achievement measures as .criterion measures, the intelligence 
and creativity measures were entered into the regression equation, first 
alone, then together. The scatterplots of grades and intelligence, grades 
and creativity, and creativity and intelligence are given in Figures 
6.8.2 through 6.8.4. 

The regression tables are given in Tables 6,8.5 through 6.d,8. It can 
be seen in Table 6.8.5 that the intelligence measures are correlated .69 with 
the grades, thus accounting for approximately 48 per cent of the variance in 
the achievement measures. The F value is obviously significant at the .001 
level. Table 6.8.6 shows that the creativity measures alone are correlated 
.220 with the grades and account for approximately 5 per cent of the variance; 
the F value is significant at the .01 level. Table 6.8.7 shows that the 
two sets of measures together account for approximately 50 per cent of the 
variance in the achievement measures. The fact that the partial correlations 
are almost identical with the zero order correlations indicates the independence 
of the independent variables. Finally, a stepwise regression was included 
to show the significance of adding the creativity measures to the equation 
after the intelligence measures had alreac^ been used as an independent 
variable. It can be seen in Table 6.8.8 that the amomt of additional variance 
accounted for is significant at the .05 level. 

This seems to be fairly convincing evidence for the independent effect 
of creativity on achievement at least in this sample using these measures. 
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6.9 Conclusion 

The results of this chapter confirm the hypotheses listed at the end of 
Chapter 5. In this sample of high school students, the Uallach and Kogan 
materials provide a set of measures which are coherent. The factor analysis 
of the correlations among these measures gives good evidence for the figural 
and verbal subfactors hypothesized to be conqponents of the creativity 
dimension. 

The creativity measures were shown to be independent of the conmoa 
measures of Intelligence used in this school. In addition, the creativity 
measures were shown to be related to school grades. Indices of creativity, 
intelligence, and achievement were developed. Multiple regression of school 
grades on intelligence and creativity confirmed this conclusion of a 
relationship between creativity and grades. 

There are many more areas to investigate in these data than have been 
included in this thesis. More detailed relationships between the subfactors 
of creativity and specific grades seem worth examining further. The factor 
analyses indicate a nusober of worthwhile avenues of research. If such 
research is continued, it seems not unlikely that it will suggest reliable 
ways of changing the educational system into one which is much more responsive 
to complex htman behavior. 
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EDUCATIONAL TESTING SERVICE 



Area Code 609 
921 . 9000 
CABLE-ED IXlES 7 S VC 



PRINCETON, N\J. 08540 



Dixnsivn 
of 

Psychol oi\ical Studies 



August, 1969 



Dear Student of Xaverian High School: 

With Brother Kyrin Power's permission, I am inviting you to participate in 
a research study of some new educational materials. I have explained the 
nature of the materials to Brother Kyrin Powers . They are neither personality 
tests nor academic tests* 

If you decide to fill out and return these materials, you will then te part 
of this study* Your responses will kept strictly confidential ty those 
involved in researching these materials. Some time during the coming school 
year, I will meet with you at Xaverian High School to explain to you what we 
are doing with these materials and to invite you to participate further in 
the research study. 

After you have had a chance to look over the instructions and materials, 
decide whether or not you want to participate in this study* If you do, 
fill out the booklet and return it ty August 31st. If you do not, simply 
return the booklet as is. 

I hope you decide to participate in this study. I look forward to meeting 
you later in the year. 

Sincerely yours , 

Richard T. Murphy 
Princeton University and 
EducaticrAl Testing Service 

RTM/lic 
Enclosur3s 
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Hame ^— — 

Last First Middle 



Address . 

Number Street 



City State Zip 



Birthdate Age 



Years Months 



Directions: If you desire to participate in this study, complete the 

information asked for in the follc3fwing pages. Use as much 
paper as you need. Add your own if necessary. 



When you have finished, simply return the materials in the 
envelope provided. 



-156- 
-2- 



Part I 



On each of the following three ^rages will appear the name of a familiar 
object. We would like you to write down all the different ways you can think 
of in which the object might be used* Do not hesitate to write down whatever 
ways you can think of in which the object might be used as long as they are 
possible uses for the object that is named. Use both sides and any additional 
paper you may want* 



1. a newspaper 
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2. an automobile tire — either the tube or the outer tire 
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3. a shoe 



ERIC 
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Part II 



On each of the following three pages will appear a pattern of a particular 
sort. We would like you to write down stll the different things you can think 
of that each complete pattern might suggest. You can turn the pattera around 
any way you like. Do not hesitate to write down whatever things you can think 
of, as long as they are possiWe things that the pattern might suggest. Use 
as much paper as you please. 



ERLC 
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Part III 



On each of ths following three pages will appear the names of two objects. 
We woxild like you to write down all the different ways you can think of in 
which the two objects might be alike. Do not hesitate to write down whatever 
ways you can think of in which the two objects might be alike, as long as they 
are possible similarities between the objects. Use as much paper as you please. 



a potato and a ccLrrot 



a train and a tractor 



a grocery store and a restaiirant 
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Part IV 

On each of the following three pages will appear a continuous line of 
a particular sort. We would like you to write down all the different things 
you can think of that each complete line might suggest. You can turn the 
line around any way you like. Do not hesitate to write down whatever things 
you can think of, as long as they are possible things that the line might 
siiggest. Use as much paper as you please. 
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APPENDIX 2 

CREATIVITY DATA: UMLFA TWO FACTOR SOLUTION (N=140) 
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CREATIVITY DATA (N=140) 
UMLFA TWO FACTOR SOLUTION 



UNIQUE VARIANCES 



.669 .471 .42.9 .039 .078 .119 .141 .107 .266 .266 .391 .138 
.451 .406 .434 .071 .089 .118 .258 .308 .498 .156 .403 .110 



1 


.268 


.509 


2 


.433 


.584 


3 


.312 


.688 


4 


.898 


.393 


5 


.875 


.396 


6 


.783 


.517 


7 


.481 


.792 


8 


.474 


.817 


9 


.352 


.781 


10 


.752 


.410 


11 


.643 


.442 


12 


.800 


.471 


13 


.638 


.376 


14 


.687 


.350 


15 


.545 


.519 


16 


.918 


.294 


17 


.914 


.275 


18 


.865 


.367 


19 


.551 


.662 


20 


.383 


.738 


21 


.112 


.700 


22 


.849 


.350 


23 


.678 


.370 


24 


.851 


.408 



With th3 scores of student number one hundred included, the factor 
structure is still quite clear. 
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